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Abstract 


This n-jM.n l ijs-N'rilw.Ts nefeiLirdj ahimt flow grtpli* hthdeH- dirc'eldl, JtryHie 
tfraphr whU'h absEnnE rn^hrf'Ht'fit.'M i«ti« tised in 44 V 4 iriety of ArtiHeiftl luldlis- 
I®™ applkjiiticHiH. Flow ujriy be ilrrivnl front gnmmwt tmadi 

as strings niny hr derived from string ^fluuiiB^; this MvAd ppot'jJle 
forms a useful mudd for Ihe sk-pwise refinement professes i.isixl pel girogriim- 
Llli]JIK 4tfui other (il|iillcvrhlg <]olil4ti»F. 

TEte 4'i‘jj thil lesutr of then report is a fuirsiri}; ft]#iritlmL fur fin-w RTJiphs. 
Civen jl How Cf4tJj j]j irtr jieuI 4t How groph, the jl||^L»|- irliku determine* whether 
■Hip puoiliar gnutAkt the graph 4uid n if so. flnd* ah possible derivations for 
il The iiUt I tor has iinpE-pmeuI ed the algorithm tn LISE 1 . 

T1 le intent of tins report is Eo Kri-kik** tkiW-gifFiph [Nirsnig avjiilahje jlh an 
aiintylic tool for reFenrehers lit Aj-I i tidal Intelligence. The report explore 
the intuit ioclf behind the parsing algorithm, am Urn? numerous, extensive 
examples of its behavior, and provide* soil*’ guidance for those who wish td 
customize the aJgnrjthssL to their own !««<■*, 
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A ck n owle d gem e nt s 


This report lias been a long., long time in the making, so I have hail time to 
get help from mimy> many people. Some helped me with my research, some 
helped in? with my life, and some helped me with both. I am grateful to alt 
of them, and especially to Charles Rich., who has stuck with me through A 
few fast tsnies and many slow ones. 


Chapter 1, 
Introduction 


Tb]& report summarizes rcieirda about fit jtf graphs. a graph-based repre¬ 
sentation abstracted from (Lose used jjj n variety of Artificial Intelligence 
fipplkalifttii. A flow graph is a labeled. directed. ae^Lic graph whose nodes 
arc- annotated with peri* positions at wluch edges enter or leave che node, 
Here is an example of 4 flow graph: 



We can generate complex flow graphs from simple ours by replacing angle 
nodes with multi-node subgraphs, The obvious analogy bctwi-r-n this process 
and that of string derivation from a eontoKt-frec grami».'tr gives rise to tbe 
not Lon Of A /in a. grammar-, a set of rewriting rules whkb specify how to 
replace given nodes with pre-sperilhd subgraphs. Heme is an example of a 
rule from a flow grammar; 
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i JiProduiTinn 



The central result of this report is A parsing elguritlim for flow graphs. 
Given, a Bow grammar aud a EoW graph- the algorithm determines whether 
t.Lc gramma? gcnfrilsltfs the graph and. if so. find:* All pos-siblo derivations for 
it. The algorithm runs ill time polynomial ill fh*? number of nodes in the 
input graph, with an eXpossept and constant of proportionality determined 
by the input grammar. The author ha? implemented the algorithm in Suitf 3 - 


1>1 + Motivation 

The work described here grew out of the authors research into automated 
program analysis [Brutsky LflSl.. done as part of the Programmer's Appren¬ 
tice project At. the Artificial Intelligence Laboratory of the Miftwchu»etta 
Institute of Technology |Rich and Waters EDSl|. In the work of t.ttAt group, 
programs are represented as annotated graphs. callrd p/orw. whwe nodes 
stand for operations and whose Arcs indicate control and data flow between 
the nodes (Plrni? are additionally annotated with a great deal of Other 
information about the program they represent, hut the details of these an- 
riic.Lt.im.? ilu not concern us here. Interested readers should consult [Rich 
1950 ].) 

The author b idea was that the stepwise-refinement process, wherein high- 
level program operations are implemented fis groups of Lower-level opera- 
titms- could naturally he modeled as a plan-rewriting process. Tlius. dow 
graphs were developed as abstraction.-* of plan structure. SIihW grammars were 
developed to encode allowable derivation steps, flow-graph derivations were 
developed Os models of plan derlYAtiblW, and structural prOgrom analysis 
could he effected through parsing. 

This progrFUn'Snaly&i H work is continuing. hut docs not cxrtlCeTP m here. 
)r| H ji A . graphs. while developed as ad tec abstractions of plans. Are general 
enough to serve eis abstractions oF like graphical represnltatkuis. of other 
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(Em]jatri-i. Tin- intern uf thi* n-pmrt lh 3l> make flow graph parsing 
as ;Mj puj^lIjTli <1 for AI jvsrnnrhers jjj fhc^c uther i.li i i i ii i j i h. 


1.2, Background 


Tin* ^rtrtun' uf flow gjnpli* and flow grammars ims bivn mfj ucurod hj early 
Norton iurh ffrfltni*wr,T [Pfaitz and IWi.Md 1(X33; MoufatiEiii I DTP. PavUdiH 
J&i'J:. but none nf This work was concerned with paising. The stnirtui^ of 
omr pairing algorithm arose frum cuvftkl Ktudy uf Evlcy's aEgorithni | Earley 
10U0 and Denied E, KjmtJi'H aemUia] work on Lft(Jt) siring grammars :196jj. 


1.3. Structure of this Report 

Chapter 1 of thia report is this infroductiun. Chapter 3 dencribe* flow 
graph*, flow grammars- and flow-graph derivations in doLai]. Chapter 3 
pn'WJitK a derivation of Earlcy e algorithm which differs considerably from 
thtwc fount, in standard sources. TIiLh denvatioitB ia given as background 
h>t tin., very similar derivation of tho graph* parsing algorithm pr-csumted 
hi. chapter 4. Finally, chapter & discuss*-* fln-w graphs. grammars, and the 
jutrsiug algorithm. This discussion motudo a brief complexity analysis or 
the algorithm, and HtLggenliocis far related research. 
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1 Ifjtnulut'tkui 



Chapter 2, 


Definitions 


h this chapter wp define flow graphs- and flow grammars* and give (he 

mechanism by wltich a grammar derives a, graph. 

2nli FJdw Graphg 

A flow graph is a labeled* acyclic, directed graph whose nodes and edges are 

restricted in a variety of ways: 

* The label of each node is called its type. 

* Each node has a set of input parts and a set of antput parti. These two 
sets arc disjoint. All nodes with the same type have the same input and 
output port sets. 

* The input and output port acts of flow graph nodes are never empty. 
That is, aft nudes; have at least me input and one Output port. 

* Edges ]n flow graphs do not run merely from cute node to another, but 
frutu a particular output port of one nude to a particular input port of 
another. No two edges may enter or exit from the same port, so a node 
can be adjoined by only as many edge* as. it has ports. 


LituLiivcly, a flow graph looks like this: 


fi 


2 'frn it r< ms 



Notify thjit ports- (which art 1 i dentiti-rd by mmimr mi not at ions on the nudes} 
jM*ed not have edges adjoin ini; them. Any input- (or output] port in 3 flow 
gmph that dues not laaYic an fdge running into (or out of) it is called an 
mpiit (gt output ) of thal graph- 

Notation 

We will always direct QW flow-graph diagram* from left to right- W> will 
often subscript node type* so as to make them into unique lauds, (This 
avoids awkward roil? trUL't.ii>ns such as “"the third & from the bottomd-eft- ) 
When wo do not rare which port ael edge adjoins, or if thin is ikmc dear 
from contort, wr will furdt- port aELELotaiions If W( L omit all the ports an¬ 
notations oil a node, we will oft fit omit the circle drawn ttfoupd the nodes 
label FibJtiEy, wo will always empliastjo the inputs and outputs of graphs 
by adjoining them with edge stubs, called the leading aitd Ifflihnj edges of 
the graph, 

Here is the graph wk saw above written using the cffliVnltifllll juat dc- 
Urrikod: 


-.2 Flow (?r-iiiiu^ 


i 



We will ass this form whenever possible. 

Tcrminolojiy 

The Im^srf m/armatfort for a node in a graph is a set of (port, edge) ptun 
deLajhug winch edge ajjuinn ear]i port on that D&de. For example, figure 2,1 
shaws a graph wbo*e edges luvs been labeled (or rasy reference, The linkage 
information for nodes aj and tj in this graph, is; 

flj, 

(Mi) <W 

(Ml) (5 n ej) 

M {S,n) 

In keeping with our Left-tt>ng£it conventions, tbal portion of a node's Linkage 
information wliicli involve# only input {reap. output) edges is called its Itfi- 
itijfracre (rejp, rip^r-j'rjttrtgr) information. 

2 . 2 . Flow Gram mars 

Fh™ jrammnn are a geutTaliEa.tjon of Cmtcxt-free *f ring grammars. Essen¬ 
tially. a flow grammar its a set of rewriting rules, where each rule explains 
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2 Definition*! 



FigitfE 2.1 A flow graph. TLe edgva of this graph !l*vf beea Hibctrd For EJiay 
rrf^irnce. 


how to rcp]Aw a node- in a graph with a particular sub-graph. Just as a 
string grammar gradually rewrites a singlr-clefflOfit st fists as a hinger and 
longer String, a flow grammar gradually rewrites a single-node graph as a 
larger and larger graph. 

Mnrc precisely, a /loir gramPiir (7 conswta of ■! parts: a -set P of prvdue- 
(i'puj, two disjoint sets of typos jV —the BfUt-femMiwk—and T— the termr- 
rniis, and a distinguished non-terminal type S —the .start tjipe of G. Each 
production in P consists oF tlLCfr. 1 parts: two flow graphs and a list of port 
correspondences- The first of the two flow graphs—the production's teft- 
fcarnJ irtir—consists of a single node whose type must he from N. The 
second of the flow graphs—tho right-hand side —con-si »ts of nodes whose 
types arc frons iV L T The left and right-hand side* must have the same 
number of inputs atld outputs, and the list of port correspondences is; a I I 
correspondence between inputs and outputs of the two sides!. 

A flow grammar is shown in figure 2 2 Each rule maps a single node to 
a graph. The left-hand side node of cadi n:lc must he * non-terminal, thac 
is. of a non-terminal type, while the right-hand ride graph can mix types at 
will. [We will indicate non-terminal types with capital Letters, and terminal 
types with lower case Letters.) 

The inputs of Hie left-Hand side of a rule correspond one-to-one with the 
inputs of thu right-hand side, as do Hie outputs Where clarity is needed, 
we will indicated this relationship by drawing lines between (he odjje stubs 
adjoining corresponding ports, as was done above. Where it s clear, however., 







2.‘I Flaw f.VriJJJJJJLlTrr 



Fijiur 2 ,jE, A Slw 



















in 2 JA-fijjjfliers 

w will uuUritc Hie ntfnufiidtirp dimply by nain™iu.}' the iiEigmneHi uf 
Left -liiuid ride «-dge stubs with those of till" rigid-hand jii lLi-. Fof iMintflr, 
the inrund ride iti the sLmw‘ ^luumiir could haw been written jls fellows: 



Notice that there is no flow-grammar equivalent flf an “c-rulc" in a srring 
grammar: that in, there arc u« flow grammar rules who!?* right-hand *id« 
an! 1 empty- This is because it 'is meaningless to replace a node in a graph, 
with nothinJ! (he edges that were adjoined to (hat node must go somewhere. 

2*3* Flow Grammar Derivations 

Flow graphs are derived from flow granunars in the expected way. We 
start with a graph consisting of a single S-nodc Eind then rewrite it with an 
applicable rule from tile grammar- This gives us a flow graph. If there are 
no non-torminals in the derived graph, the derivation stops Otherwise, we 
pjrji a non-terminal and a rule that derives it. and replace the non-terminal 
by the right-hunt! side of the nak. This gives lls another graph, and the 
whole process, iterates. 

Of course, when we replace a non-terminal hv a right-hand side that 
derive# it. we have to do something with the edges that adjoined that non¬ 
terminal This is what rile port correspondences in rules are for: if p was 
a port on the replaced non-terminal, then the edge that adjoined p [if any) 
3 E made to adjoin p"s corresponding pact in the replacement graph. The 
restrictions on rule for Illation instLro that there is never any question as to 
how a right-hand side should replace a left-hand side. For example- figure 2.A 
shows the derivation uf a graph from the grammar given in She last section. 






T..1 F|,>iy Qrn.trtithir DeTjvfltioiw 



FigiLrc 2.3. S™p]L Flnw CiAph Drrivuti&ii 















£ DeJJmTjiniJis 


Chapter 3, 

Motivation for the Algorithm 


Earley'a algorithm is a. well-known, string parsing aJjpurit Jun (Earley J%9|, 
It takes a jit ring gram in nr ami jl .-string ns input, and determines all powdbk 
derivations yf Lhat Birin g from Hint grammar. Thir output of the jUflotuliin 
is a lisf of represent at ions known fta rtcrua: the acrepl ability and dcriv&lionB 
of the input stnng are enctkUtd in ibis list. 

This section presents a dmvftfifm of Earfojrs algorithm that differ* sig¬ 
nificantly frti-rH those found Ln statj 1 1urd sources. For $ gjyrn input grammar 
and string, WE firs! construct. * u.on-dc'tcrnLiLii.atjc flEack-basod parser for the 
grammar. We then deterministically simulate the behavior of that parser 
when run on the input sTFtsig: (.he representations of tbe parser’:* rohfig- 
urationH generated Ln this, simulation will be homofflaarpliic to the items 
produced by Earley's algorithm when run on the sacm- input. 

The derivation given here ss pmentCil as background for the very simitar 
derivation of Oiir flow graph parsing algorithm Riven in the next chapter, 
Mudi of the complexity inherent in bo Hi algorithms arises from optimisa¬ 
tions th*t are employed in the simulation process: sauce the intuLliwu under¬ 
lying those optimisations are the same in both the stung and graph cases, 
we believe that presenting them in the relatively familiar contort of stnng 
parsing will make their Use in graph parsing more comprehensible 

3-1* Non-Deterministic String Parsers 

Given a context free grammar ft with productions P L . .... p„ and start 
symbol S, the following construction yields a non-dctcrmiubilic slack-baaed 
parser for ft. 
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3 JlfufivAtfiiu JfJjr the A ?.i^v3 | rr^Jdjjj 


|. ('(KHfltnict n rfnh-HiHTtkitM’ r« , !i|'»iiBC | r for the riAde nf esnrli P\. 
A Hrnfr in flu 1 - recognizer R, CEstuit meted fur rule P x will rtsJisiA nf n enpy 
of Fi'f right-1 and Ade with n dot placed just to the left or right i»f mif of 
iLs symbol*: 1 ]jc aruli 1 siot nf JZ^ will colminl of <dl Hr .stales fuTiLnd ijj Hii* 
way The state transition ftmrliiin of R, will limp (*tate. symbol} junri- 
U'i states: each (tote wit]] a dot to the loft of :<omr *y[»bri] 9 will have a 
t rarijat Lon 031 s to the ntote whose dot is just to the rigbl of jj . The initial 
gtatf of Tit will bo the state with a dot to the loft of I lie symbol 

in F-'s right-hand si dr; ils final (aecepting) state will bo the alatr whose 
dot is ID the right of the rightmost symlnJ hi P, s right-hand side. 

For example. if Pi is flip production A -» zPAj/. then tike rocogniEer for 
Ft will have the following five siatcB: 

\A -* z-BAy j 
j A -* zB • Ay| 

| A -*+ zB A ■ y 
[A —* zBAy ■] 

and tiff transition diagram for P,'s recognizer would look as follows; 



Mlllal Hill «»*l |tu* 


2. Create a state-basrd machiaie P whose state spare and InULSitlon fii action 
if the itnkm of all those of the rfftOffn-iaerH for the F„. The initial arid final 
states Of F are the initial and final states of the recogniEer for S, 

,1. Convert P to a iim-detemunistk stack machine by adding a stack and 
instructions ns. follows: For each state * which ho* a trail fit ion on a non¬ 
terminal lupus, ossorkited instructions lo that state which (i) posh the 
state onto the stack and (n) put P into the store state of lEli? recognizer for 
S*mie product ion which derives that non-terminal, (If the non-terminal 
tad which a state has a transition ban rt possible derivations, then this 
step will associate n mstructions with that state.j 
4. Complete P hy adiling instructions os follows: To each accepting state of 
a recognizer Tor a A, add an Instruction which {t} pops a state off the top 
of the slock and (si) put P into the itiitt which hi led to buy the popped 
state's transit i.m the non-tmiiiua] derived by ^ 


3.1 NwDrtvnwiii#tir String Piu^rr.s 


IS 


The lu.Ti fiiito I* limit ii 


IN thin w:ir>- is j| Irvp-flcwn McnMlclerujirii/tir nuiTWT 
r.r *riwJ fru» «.* It I* .. . (>#1 . . 

I mo bum Ilk input riiLil imkmz JipjffTiprijtf,- HtjLEk trmisitKHw a? it <lura so 

W]jn "7 11 ™ h,w * "*«■*■ ^1* w «™i«l ,1 *rk iusrmrtiotiH. it dwtw* 
0n! , uf t,hw mrttri ‘ rlu ™ « J<1 (Thr ch.wi. wwlml Iktt is wturt 

^ thr W, l.rst ™ M i,]pr act sample HJ f , u , it 

a P&THf+ - ^ t]] ™ dS ™» «*l» implication* of the roilstriinljujj tHmitfue 

3-ld. An Exampk 


Consider flto following grammar {?: 


S —* Aa 
4-*c 
A —*■ cA 


G drives all String? efflliUting of one or more cV follow^ by an a, We will 
carry Out tbs construction bribed above da as to prince a for G 

and them run tllis parner on tbe input cca. 


First, we cmutnict State Okwhines which recognise each of the Hw- 
tfcojiii ]in ifj-. Hkw wre as follow ft 


IWcTijr. if Wf |j HTp 


£ AftanlJy. tliis jrinrhin?' a inerdf mj arrrpiof lx* well 
f S' rbn DmWffTJ:lna l whkrh 

Li “ avea «i«»^ p -u , utput 

B- kUnuhiE (knT-ntmn fxir tlie jcn-lf-urc wc-rpU-J, Tbus, view P , w 


a piVjcr. 




3 /ii-j- fhr 


jg 


S—-Aa t 


A a 




Now wc create the union machine and replace non-tcnainJiJ transitions with 
pushes: 


,■!. J NHJii-DWrrjJu'rjfttfjr' ,S’frijjfr PnnfTJn* 
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Finally, wo complete the construction by siding staci pops on reductions; 








3 Xic/tmitiini for th<: AItforHh m 


Huh cuujiilrtn* ihjt piim-t. We will rrpjTsrut a (fiveti muJjipf.rii.Hiin of the 
parser as 

(input position) [(jftnto); ({dark ttt p);. . . : (stack bottom})] 

where tliic- stale* atv Wjmwiltod IUD&I tllT dot ffpnwiitntiin] shewn rtlj-ovr. 
(Rorajj thill Mark entries nrr stales.) For example. whru mouing this 
patter on the 1 string era. it slurl* in (Ilf following roufiguratiou: 

Off) [5-t*4a,()] 

TJlf state [6’ —i ■ Aa ha* rwo t rail nit Lon#: on jm.ift itutnirt Lons. The. 1 parser 
MLUt choose one of the two, leading it into one of these Two configurations: 

Ofc) \A^-cJS-* ■/tall 

14 - -c4, {£—Aa)] 

At this point l no more starfe transitions are possible without reading an 
input symbol Thus, the parser will read the first c„ loading it Into one of 
those configurations; 

1(c) [A^c-,[S*-A a )\ 

[4 — c-A,[S— -Aa)\ 

The first of these two ronfigurationB i& an accept bag state for the rule A —■' e, 
and allows a pep into the following configuration: 

1(e) |S-*■«,()! 

while the second configuration is in A state containing pu-rk transitions to 
the these configurations: 

l(eji |.4 —+ - e. [A — 1 *■ c ■ A; S — 1 ► ■ Aa)J 

[A -i-ciU-* C‘Ai$~> ’Ao)| 

Once again, no more state transitions are posable without reading another 
input jyijjbot- 

We con sit inmanie all the possible emuptltatiom to far in the following 
tubular fashion: 

m [j- 4 -, 0 ] 

|A — -c,{S -* r -4a)j 

| A —* ■ cA. {J *=+ ■ Aa )] 


3 1 .Ni m-Dirf i-rituiuntir String Parser* 
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1H [A-* C ‘ r (S^.Aa]j 

\A^e-A.(it^-Aa}\ 

M -f c ' -*5 'A: A 1 — ■ itnJl 
'{A -+ ■ c,4. (A — c . X: S' - AclJJ 

We wilt 1JS1 " t]]i * ft™ ratcnslvely fa, summarize action? uf these jwtotb; for 
example, the remainder of the mil of this parser on the string cm goes as 
follows ■ 

2{ee) f A^c-,{A^cA,S^Aa)\ 

U -* cA.A*)} 

I s A o, ()] 

M — u^,(4 -t- c - .4: S -♦ .^] 

1-4 -t -c, (oi —» c, - A\ d. “4- c ■ A\S —* -4a)] 

\A -I ■ c,4. (4 — e - A: A -* e ■ ,4- S -* ■ 4a)] 

SfecaJ [£-»A»* t (j] 

3,1.2, DiSfCuubion 

Ptrom one point of view, this construction technique produces Classic recursive- 
descent parsers, such as those presented in undergraduate compiler classes. 
Where a recursive-descent parser would have a subroutine dedicated to the 
recognition of each rule', right-hand side. Ukk parsers have state-machine 
rerogniiers, ancf these rtcogniZ(TB air- linked together via a U suhrcintine- 
cair mechanism bawd on a Stack, Jn what follows.. we will often describe 
the actions of thm? parsers using terminokijy Buggosterf by this metaphor. 

From another point of view, this construction technique products clna- 
sic push- clown automat ac&. The state-based machine* Constructed for each 
grammar rule are finite-state recognizer* for the right-hand aides of those 
rules, and the dots in tlicit states indicate the esjx-ctcd position of a read 
head in the parser's input In this contest, the stack push and pop imitmc- 
Sions Aft as c“transitions between the various recognizer®. and the parser 
appears a# a non-detfflmiaifltie push-down antonmtun whose Unite state con¬ 
trol compare* substrings of the input against the right-hand side of gram- 
mat rules and whose stock monitors the cciiTcT-OEithc'ddrdiiniE. of the input 
a* a whole. In wliat. FuIIcavs, wr will alio u«r tomriutilogy suggested by thja 
met-aphor. 


so 


3 MrW.fva.liuu flu - fP h■ AIgurithm 


S.2, Simulating the* State-based Parser 

Jlj order tLf uaiiinlnlf n pmer ruiastrurtcd ns abort'. we must perform all 
the nrtioux whii'lj fulhiw fmiu nil ]j< iKe^il»l* L iitiaj-debTmmislir dumrev. The 
nviirsivoHdoHPmt iiH-taphitf lli.at wi' tb this with a flrqtuaitiAi sqt- 

prthiidL h tmt employ h twrktrnrkhjg while the automatem mctnpbrtr stLRjjf^ta 
a parallel approach iai which ulke simulator state reproaeuta a number of 
rejidiablo parser state's. We shall adopt ftiL» latter approach. Atui keep trark 
rtf all the (state. stack! pairs noetulilf by a parser at a nch step of the in¬ 
put.. The ru.Hiilt of the fiiiEtuJniian will be a sequence ”f lists of reachable 
CCW'i figurations, much like those used in the sample parse above. 

3.2,1. Prelim inartea 

We use here a slightly different representation for the stack repnent of a 
con deration than Vie did m the sample parse aW. In line with our 
subroutine-call point yf view on push operations, wo wilt not keep the whole 
atari with one:: ■"> rilijuration. Hitler, eedl time we make a transition to 
the initial slate of a roryjfuiw-r. we will keep a xsiu+ti painter which indicates 
the configuration we were ;tt before entering 1 |aL state. 

For example, we presented above the configuration sequence for the parse 
rtf oca. If we make the reprasefituliuimJ rEtangc* J1.14I described, we obtain 
the following, more compact representation, in which we have subscripted 
the configurations for use an return painters: 

0 {c) [S—itfl, |j 

| A —► ■ e, 1)2 : exp and A from item 1 

f A -* -cA, l]a 

1(c) f A -*c\ l]* 

|£ —•■ 4-u, ja :retum to item 1 
| /t — 1 * c - A, 1 |e 
fd -* ■ c, 6)7 
| A —■ »cj4,&la 

2(cc) j A — 1 * c j , 6]o 

\A f 

[S -* A - a> (is 

I A —1 * c - A, S] J 1 
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Si 


M-^rvt. LS| J4 
S^ca) [W-ijI*,,. ] 


rFl]] Nj4 ' fanim polnt^T-)] pair* u^i Jim* r | cm j. to ilirtiupiidi 

rlLftts from ausfigiiratiou rcprt will nth mu t] J4l ( show the etnupjtff st^.? 

2.2 1 Multiple-Call Collnpafnig 


It i? Convenient to think uf rids method as siauulaLing, ua t one, but many 
amirdcipnniniatjc parsers at the same time. As- these- parser* run. they 
imfep diffomil decisions at uacheWe point. tod rlie simulation keeps track 
wf al] the different configuration* they get into Al any portion in the 
input. Ole current state of any given parser j s rontaim-d in mine item oil the 
current item list, and Lhe cout<mtE of that parser's slack may be computed 
hy following return pointers from that item upwards. 

It may happen, Jwwovct, tliJit two parser*. whose stacks differ enter the 
Same state at tic gam- position in the input. For example, consider the 
following grammar G': 


$ -* S' 
S^*S U 
S" -* S- 
S f -* Aa 

4-tf 

A -* c,4 


C ilerives the same Strings as Use grammar G given above. However, if G 
derives a string via derivation tree T. then C r derives it via the following 
two trees: 


J T 2 nSr rirlnliaQiliip with Earley itrtoa id motord beJow. 
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Tree 1: g 


Tree 2: 



The pfiriilhE fitniftnr? uf these trees can K l wCfl di*nty in tllLo following 
amuktion of -a of ctfl under f?': 

0(0 |£--S r , jj 

|£' -AutIJi 
|A —* ■ c s 2jj 

1^ -**M* 

[S^-S\ ] 4 r . 

[S’ r — - rflci, ^It ;cimpre with item 2 
| A ™* 7]a 

IA —* -cA, 7]g 

1 (c) [A -tc-, 2 ]m 

[S'- A'*, Ijn 
[A —* e j A, 2|n 
[A - -c, 12 |u 
A — ►cA, 12} l* 

[A-c % 7] w 
[S' — A-n.Gjifl 
[A — C' A, 7|it 
[A — ■ Gl I7]k 
\A — ’cA.,l7],g 

4(«) (A-c> p 12]aci 
j A — cA 2]l| 

[S' — A ■ <t, l]zz 

[A — c - A. I2\a 


icampart itfflis IS-l? with items 1G-1J 
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2 a 

|4 — ‘a2S|h 

|y 1 — -cA.33 34 

\A -ijvITJw 

|i4 —* fi4 r . 7|?r 

[j4 

i- 4 “*■ ‘t.215j3o 

[■•4 —* -c A. 

3{^^rt3 [>" r —<• Aa ■, 1]jj 

I*-s’-. Is 

'■S l —* An 

[ S " -s^sSIjb , 

l» 

The possible dsnUguralions obtained upon reading wh of the input tokens 
break cleanly into Turn groups whoso srji.ee- transitions arc Identical but whose 
stack eirriroumfltf is different. Each group can be thought of as containing 
the configurations of a different parser—one predicting the derivation that 
Starts S S r and the other predicting the derivation that starts 5 — S* —* 
5*, The similarity between the two groups is a corollary of the fact that our 
grammar is con tojrt-free In botfi cjsifj we are seeing the transitions involved, 
in the leftmost derivation of era from S'\ tliese transit unis must remain the 
same regardless of Hie context of S f Lu the derivation, 

The key observation here is that, when the recognizer fur a given rule 
is called, the stnftmg position af that ttCogmicT :'re j-rapifi rompi'c (ety de- 
tennines t is fttffnuNor, A particular recognizer may be edit'd from parsers 
With a variety of stick configurations. b«( if all the calls occur at the same 
input posit Lem, We need only simulate the state transitions made by that 
recognizer one?: thr results can ttien be used in att fhi- parsers that made 
the simultaneous calls. 

With cmr representation, tlia* optimization is easily made by turning 
multiple calls to the sante recognizer at the same input position into a single 
call with multiple returns. This leads to the following parse Eist for «n under 
(each item now con tabu a set of return pointers instead of just a dingle 
om?); 


0(0 \S*-S\ Oji 
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[s^-s\{\h 

[jF{2}], 

[^^■Aj.{1.3i|* 

f^-'^ {^}|i 

A — - rA, {-i}ift 

1(c) [A-h:-,{J}[ t 

Ji" 1 - A-a.{l,3}] e 
j A — c-4-{4}!b 
|A- ■e,f9}3io 
|j 4 —*■ -cA, {9})]] 

2(cc) [A -* c-,{9}]ia 
|A -*■ cA-, {4}]u 
[S' - A-a. {I,S}{n 
[A —* e■ A. {0}]]i 

[A — "C. {InSl.IE. 

[A -* tA. {1^}|h 

S(ccnl [S' — Aa‘ n {l-3}]ii 

fs-sSO u 

|5" - 5 f ‘,{2}}» 
jiS —* 5*", {Jj-ji 


.ropjjiarc with ilcui? 2 7 ubiwr 


jicturn to LtvEii I, arcept 
;Teturn to il«ll 3, ,,, 

; ... accept 


A lwful way to DDhcfplUftliJIO t)jf Liptiraiifttion petformf'd here is to visttEihii? 
lh.0 parse trct-'H , ’ljni]l _ by the pushes nnd popH of the vori.Mii: poners being 
KilULtLated. Ik-fure the opt in libation, the simulator built frotfc of the correct 
derivation trees: 


,1.2 Siumlnting iht' Stxtf-h/mrd Parxrr 



AfTiT the optimization, it btriftla th-0 fotkwLng hybrid structure: 



Tile JattLT structure contain* tile same information about (he parse a* the 
two previous trees togriher. 
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3.2.3. Left‘recursion 

An jttj]nirt:mt niili-caM* tti which Mini KpU'-rnil collapsing i* applicable is tbflJ 
df (ffe ■ n-H-11rs*ivt* urattimaT mliy. TLuw ruli's pn-i-tnl wdl-ktmwt: lUtHmUicH 
for OcHTjjjijjistk rti l LLr!*ivL'-i]i4w , ( i 5jf fULF^Tii. Wcanse Hk> parser rmi xml kinw 
how many (Lux'll l» LtiVmke the nTUrsivi' cxpAUHiotj of ji ntiis-tormina] without 
looking al mn\ in the input For I’Xitri i J>Ll-. ^lh i^UIlt lIl-l' following grammar: 

$ - .4a 
A-k 
A -» Ac 


Tin* grammar derives ocactly the same String* a.-; t.tn- right-mirAi'iT! .gram¬ 
mar G given above. but consider tiii' folEi nving 'parse" nf the input string 
rto (we have not used multiple-call collapsing); 


0(f) [S -* 'Aa, |i 

[A —*■ "C.l|s 
[A —* ■ Ar, J [j 
[-4 —c,31< 

| A — Ac h 3|a 

[A — -0|* 

[A —* - Ac. 5 ? 

{A -* 'C.7|h 

1(c) [A —C', llm-i 

i —' A ■ a, 

[A —■ c L f 3|o 0 rS 
A —■• A - e, 11 M . i 
[A — e‘.a]™ + B 
A — * A - c, 3|oc-. a 
A * t 

(A -t A-tf,S|*^_ ( 

2(«) [A -* Ac-,lJ w + a ,4j 
(S A-a. 1^+^fj 
A —» Ac 3 ^^ 5^+3 
|A —* A -£ h 1] E4--*-E3Ll h 


expand A Erosn item L 
;ditto 

;(?xpand A from item 3 (uL ob| 
;nnd so an 
jftnei so on ... 

;return ta item 1 
;ratum ta item 3 
;retum ta stem 5 {uti ob) 
ifiiid so- on - -, 
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* Ae 5 ]qq ■ 'Si- 5 
| A * A " r, 3, aa ^ ^ 

3(cco| [.S’ -► An ■, ] 

[f wr- prtfnnu muitipto^'nll cuilapwiiE. however. very inln-renling 

Stappfua: 



P -* ^,Oti 

\A — * ’C, { 1- 3 } 1 2 

A —f ■ An. {|, 3} | a 

:expand item from items 1 and 3 
mote tJje self- recursion here 

1(c) 

fA —*■ o-, (l.3JJ* 
[S-A.o.O|s 
[A* A 

;retUrn to item 1 ... 

; and njain to item l! 

2(cc) 

M Ac, {1,3};? 

|£ -* A ,£ *,{}|a 


3(cco) 

[S -* Aa ■, {}]i( 



Thei subtlety here involve* item 3, which serves the same purple as items- 3, 
S. 7. fL ■ ■-, in the previous Simula I ion. We are in fact simulating an Lu.£LmC,e 
number of pomcTB here, one predicting each of the following parse trees: 



At any given point pa ft the first e Ltl the input, however, they have all invoked 
the same recognizer [for A —> An) at the same point, so the simulation kccpis 
jusc one representation for all of them. 

3.2.J. Duplicate-Item Merging 

Multiple-call collapsing rrptiiitiiM the case where differenl parse is invoke 
the same recognizer at the same point in the input, If we consider only 
unambiguous grammar, this is the only case in which recognizers invoked by 
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tin - fnilWiisg JLtrilMj'LMinw grfwiLiiNir frogmen r: 


S - A. 
A - !K 
B-+b 
B —4* 
C - be 
C -* e 


Tlsis fragment produces tile following it™ derivations of tti-C string fragment 



A 


/\ 


B 



b 


These derivations recovered ill the following parse: 


\B^bb,{ i}]j 

m (j?^mi}]« 

[A^B ^{}| s 

f C^-te s {S}|, 

[S-* 6 ■*, {!}]■ 
2{») |C-b- Cf {S}] B 

|JJ- hMl }], 0 


],4 -+ B ■ C. {}]ji jcompare with item 5 


|C-*'fc.{ll}]u 


3|bM |C-*k',fg>] u 

[C-~c-,{ll}] JB 
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-+ BC \ {}3 lT [compare with item 15 

Nhi**" (hut iErtitii 15 iLihl IT .Tie idetitiCAl. The sitnatinjit nii'iimitm 1 *] Ihtt 
is linin' -■diiiil.ir l» than ju wlnrii we invoke multiple-call collapsing. in that 
reeognisers for Hu’ Mlut' rule invoked riuiHltntksmsly by dilferetit panu-re 
liavi' rmrbrd tin- same stale at the same jjoiur iu tin.- iiifnit. In thin case chat 
*ta(e is ]jcst Ibe mcngnijiers 1 initial stale, but the same rcs^KHiing rhows that 
both recogpisers will piTfnrm identical net ions until their respective parsers 
make differing derivfltkKH decisions. Thus. as with multiph-ca]] collapsing, 
wf nml only keep one item Iu represent the stilts of both iccognisers. 


3-2.5, The String Algorithm 

Wr arc now ready to state our string parsing algorithm The algorithm 
takes as input a grammar G'aml a string a. and determines whether (V 
generates s_ The output of the algorithm Is a SCtji.tetiee of item lists—one 
for each symbol ill ct—which represent all the coEifsguratioBE renthable by a 
non-deterministif string parser for G Operating dm a. The algorithm does 
not construct a parse tree for the input, but. wt show below how it ran easily 
he modi fil’d to construct all possible opes. 

The algorithm operates by using a list of item# /„ to keep track of all 
the configurations a parser kltigliC br in after reading the (Mb input symbol. 
Given Lists J&, ..., I, *.. the algorithm constructs list /, by using three 
operations. 3 a jtcannrr operation, a predictor operation, and a compktet 
operation. We first describe the nature uf these op erAt ions, and then how 
the algorithm uses them to construct the list* Jn, Z|, 

Tlie Suiintr 

The scanner operation takes ai input an item s from list I } -\ and the j'-tb 
input symbol a.^. Let a be the at ate part of t apd r its set of return pointers. 
If a kies no transition mi a,, then the scanner does uoUiing Otherwise, 3 
has a transition on ^ to some stare s r , and the scanner creates mi item t 1 * 
cm list Jj wbsisf state part is s J and whose list of let lira pointers is f. 

We can abbreviate the scanner operation as follows: Let |d -* a. • Z0„r| 
be ail item from f t i- If Z is the j'-th symbol of the input string, then the 
scanner adds the item j A -* ol-.fi,!'] tu I } . 


’ Tht aiut-cs nf Shcwe ap<-r*hi>iin Udstn friau Earley ISMj. 
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The Predictor 

Tin,' predict mt ufHTJblicni trikes jlh input an item i front list If the n<Jtto 
part ^ of f do in not have 41 , munition run jl infli-lcmiinul nude. thru 'tie 
predictor operation (I(kv nni him', OlliiT*!**'- let .4 he the tHiii-tormniFLl oil 

which !> Ijjlh n transit ion. and let ?j, r-*.- 1 *, be the initial states of jvlt (he 

Itfu^iiitera for rules which derive A. Fur cacti , tI jh‘ plaitin'Nn: (ipoTation 
chicks to aw 1 if t]]er(+ is an item with state part on ELs( Ij. If *0, the 
predictor adds a u> the- reiyrn set of that item. If not T1 j<- predictor rftfttes 
aii item with state part and return net {a} mid adds it to I,. 

We aftti- abbreviate thepredictoroperatum as follows: Let \A —* a- B^r\, 
be on item on jfj. Pur nil miles B —> ,i3 in (7. thi- predictor operation soarclw'fl 
Ij Ibf ail item of the form |J3 —* ■ rj. If it find* one. it adit* t tfl r. 
Otherwise, it adds an item | £?.—*■ ■ 4 ?, {i}J to I } \ 

The Completer 

The complfitw operation takes ae input an item i on list f } . If the state 
part of i is not tile accepting state of a recognizor for some rule of G, the 
completer ope rat ion dots not hint; ■ Otherwise, let A he the non-tenth tod 
derived by the accepted m!fr, arid let tj, ..., i m bo the members of the 
return act of 1", The state part of each t, must have a transition on A; let tfj, 
..., a„q be the states led to by those transitions. For each the rontpieter 
looks for an item oik /-■ whose State part Is a, and whoee return set is that 
of i d . If it finds one. it does nothing, otherwise it adds such an item to Ij, 
The completer operation may be abbreviated fis follows: Let [A —* 7 %ri] 
he an item in Ij- for each item B —+ such that s E ri, add 

[B a A - 0 , rj] to I } if it i? not. already there. 


The Algorithm 

First, we construct I 0 as follows: 

1, Lf:t d|, ..., S™ be the initial states of recognizers for the rule* in G 
which derive S. For each j.. add Ml item to Iq whoso state is Vi and 
wlic^c return set is empty. 

3. Complete Jo by running the predictor on every item in it. If new items 
arc added lu it. mil the predictor on them, and repeat tlii^ until no new 
items arc added, 


,13 Siliw}*ting tin- Stalr-Kifr<] Parerr 

Nt-sL wp stum-wiHy njiLutri^i fj...., /„, ihv<-n / Ut 
/, :lh fii’l I*iwh; 


31 

Zj 1, wi' L'nnntmrt 


3- Ruts tli? banner "Wit every item in / T _j L 

4- Run tin- CPmploter <Hmt eimy item tit /, If this add* new itimu r Hf J.. nm 
thv ™ m l ),rt,!r ^ them. JttLrl npont thin until no new ii™ 3S Me added. 

5 . Run till? predictor nvcr every item in 7 If tlsjs adds new items To /• nm 
tJio predictor over them, and repeat this until no new items are added. 

A little ^JOU£]]t will eonvmce the reader that fliis is indeed the algorithm 
Used ta produce the li#t-s shown above. A string j* accepted by tins algorithm 
if/ K rout.dlls an item whose return set is empty and whose tla&e port is the 
accepting state of a recognizer for a rule deriving S. 

3,2.6. Why is this Earley 1 * Algorithm 


TJie algorithm described above docs not appear, primafaeit, to be Eafley - 3 
algorithm, The apparent difference is dtiv to a couple of factors, both of 
which we examine here. 


Abbreviation of Return Pointers 

Our Edgorittnn uses items of the form f A -* c-0 f r\ t where- r is * K ( of 
return pointed. Earley's items have the form j A -1 a - jfl, f|, where I, lb the 
number rf input symbols read when the A rccogniBcr wan first invoked. (Of 
course, at that time, the recognizer w*j represented by an Hem of the form 
\A -* -« 0 t i],) 

These representation* reem Unrelated; however, some thought revoats 
that we can encode our representation in Earley’s form, An item of the 
form A — -a.rj, when added to list I,. represents .0 call on one of A'i 
rreognisters at point t m the input. Tlins the callers of such an item- the 
members of r— nnint be a[[ the items far recognizers which expert to see &li 
A At point 1 in the input. But Uwwf items are- exactly all those on 1, which 
have an A to the right uf their dot. Thus, if an item of the form |A — ■ rr, r l 
appears on r must consist of exactly tfcn K items on /. that have an A to 
the right of their dor, so We can oncotic r with the integer s'. 
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H;i [i 1 1 Li. i l.j; of r-rules 

Earley V algorithm liaudli** grammars with productions of the fttnti .4 - r. 4 
till# uivotwM nmniit' the nmiiilriir mi U\. ami alternating tin' reput'd 
application of srtcjw -1 null 5 (instead of applying one repeatedly jiihL tlicis 
the other), 

LT these steps mw added to oar algorithm. and if the Ff , prf'ri< , iitat - uin were 
changed .'is njfRtLimed above. our algorithm dceeriptLoSI Would apce 
with the dttcriptiulL ghffll by Earley in |Abo juid Tillman 19721, 

a.2.7, Using the Algorithm to produce Parse Trees 

Tin. 1 algorithm wo have presented here is actually an acceptor, not a parser. 
That b. while if* mu pot indicates; immediately whether or not the input 
string ifi in the language of the input grammar, it does Hoi provide A parse 
tre«. 

Algorithms are available from a variety of sources A. ho and T.IEE- 

muu 1971]) which produce a parse tree from the parse lists output by our 
alnorit hist- In addition, consider the following definitions of the scanner mid 
completer operations: 

The Compktrf 

The completer operation taies as input. an item i on list i } . If the state 
part of i is not the accepting state of a recugciiicr for some mle of G. the 
completer operation docs nothing Otherwise, let .4 he the non-terminal 
derived by the accepted rule, and let ijj, i n be the members of the 
return set of i. The State part of each i, uiual have a Iransilion cm A; let aj, 
s n he tlie states led to by those transitions. For each i;. the predictor 
looks for an item on Ij whose st&te part is s, and whose return set is that of 
i,. U it finds one, it adds to il a pointer to t and a pointer to J;. otherwise 
Lt adds such an item jm-dndiitg llicflfs pointers) to 7j. 

The Scanner 

The scanner operntin-: takes as input an item i from list f 7 _i and the j-th 


N Qur r1jdtLi]l!ij nred not Londfc (]iO#e iifoilurtioihs. silica wi 1 rur biLvri'rim] caifr in gtbtr- 
FJiuiog it la grnjdL (eh wliieb BWfo prtKtiwtirais cau. oat accbi). 
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mpul syi|i1 mi] ffj, Lrt ,i In’ tilt 1 Hliiti? fnirt id"f r.jiij f its! <*t'| -nf rrhinj prmih'lT*- 

If * him nrt tmiisitiu-n im t. I Inti thr siiurtiT itnn millmig. Dthiraiftv » 

tins* n. rr jlti niliesn on | hr itrWjJi 1 junL I ho w-ajmer cr-Miti's Ati 'jtnu i 1 

li^! Ij wliiiiv ^irl ijs V. wIhwc 1 nf rvMini [xniukr.i qs r, jtti.il whirl] 
ctjutikiifsi 1]ii' intxw‘ nHiigilctiv-Fuldiil [mitiTPM .n i (if julj). 

If tile aE^uritljm cihl'H ttioHL' ■Iciliitirici-Uji^ cadi item of the form [4 "-+ ra ,r 
in t]ji‘ CfHMtnictud litt.H Wil] be the rock of a [ioititrr ifctmfturi giving aIE 
the derivation trees for that instance of ,4 »• the ixapixt. b; ptirtiniiar, if a 
sentence ifl ftfreptcd by the algorithm, the it runs of tEt-e form [S — o-, f}| 
on U will be the roots of a]] tlm dmvjitiun trees for that acjjteore. 




,? jtfohvjrficHJ for flu 1 AJ'jurilljm 


Chapter 4. 

The Algorithm 


It! thin chapter wo present our flow graph pursing algorithm. The input* tu 
the algorithm arc a Bow gramma* and tL^w graph: its output is a sequence 
Ilf Itslss- sunilur to the item Lists produced by E.iriey's algorithm. 

As as* the last chapter, we will produce the algorithm by developing a 
non■ detCrm[niiiic parser ami then simulating it* behavior deterministically. 
JJulli thr parser and the simulation technique generalize those we used fur 
strings: The vaulting algorithm :s a generalisation in that. when it is tun on 
a string graph, jt perforins a superset of the fictions performed by our string 
algorithm. 

4.1. Non-Deterministic Graph Parsers 

The method we used to con struct a parser for a stnng grammar consisted 
essentially of two steps: 

1, Construct resign iters for the right-hand sides of each of the grammar's 
productions. 

2. Construct a stJWk-based machine out of these recognizers by replacing 
their D on-terminal recognition Steps with "subroutine calls'’ or. other rec* 
egnisers, 

We will apply this satrtc method to £fi>iv grammars in order to const met 
flciw graph parsers- Tin? nature of this construction is determined by our 
genertilizalions of (il the m«-hail ism nwd to read the parser's input., (ii) 
the ncrpguiEers used for the' right-hand sides of grammar rules, and (iii] the 
linkage iiurcbnnism used to interconnect recognize^. Erich of these general- 
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iXJLtU»iJi» preserves mtuLiioii* rhnl iirise in tin- striii" rw, lmt phniscs these 
intuit julis Hit as to make them n.]i]i]ii-filtli’ to graphs a* we]] .is *t rings. 

4.1.1. Reading a Flow Graph 

(Jur string parser nmst ruffed a parse for its input whale reading if u«ee from 
Et-Fi to right. and so will uur graph parser. 'Onee" mean* UjiU the [siirscT will 
look at earls pode in the input only one time. "From left !t> right means 
that the parvw will consider node? in the pwtial order imposed hy the input 
graph: that ins. anode jn the input wiLI he ]ookLM:l at by tlin‘ parser only ttlifll 
it has; already looted at oil tlsat nude’s predecessors. 

As mentioned in t-h* last chapter, ]t is natural to think of our string 
parser as an automaton using a read, head to examine its input. This head 
mow* from If It to right CffW the input, passing the symbols rend on to the 
state-transition functions of the parser's active recognizers. 

Onr graph parsers will examine their input graph* as if they. too. had 
read heads. These heads should he thought of as “multi-track” heads which 
can he portioned over more than Ope node at a time. They Start at the 
left, edge of the input, read nodes one at a time from Left to- right, Uld pass 
information about these nodes on to the state transition function?, of the 
parss-r’s rccogniizere.. 

For example, consider the following graph: 



A parser reading this graph would start off with its read head positioned to 
the left of the graph's two minimal nodes, like this: 
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It would tlii-rt select one of t|jo two minimal node* to be rend uext -we dou’t 
tare which. Let us say it eho&ses < Slo upper one; litis would leave ttu read 
head Ltt the following positjots: 



Here tlie parser roust again choose which node to read: tet us say it aijara 
cboodtja the ^pper one. TbtS read head would move over this node to give 
the following position; 













4 Thf Algurithiu 


Al tI lls point, there mily <"lu* nude the 1<*wct nnr ftVJdbiWi 1 Fur ff-nnlljig. 
Ijjlupivdy, t]i<" riwl beiul is uni "just to the left td The s LLuiixi tual 

LHitlf 11 ; 11i<Te sk ;;<]]] fi jiirWrtlillK node wlj]r-fci llMl^t he mad flri'l- Tlrn*. the 
luut rt'iid ]jL'iw] |HM!iiull JS {L* fcdliiws: 



Finally. after the last imit i« read. wc have: 



and the read head sfops. 

Wp hai'fl indicated the potion of the read head at each stage by denoting 
the untf[ne sot of edges (possibly leading or trailing edgo?) all of wllkll foLtow 
alL (fir nodes already read aiid! precede all the nodes yet to br ttad, We rail 
tbew edge sets head position?. Mid we precisely diftracterizp the order in 
which graph parsers examine I be nodes of their input as follows: 

Each. parser is considered to hftVt ft Stead bead. The initial head position 
of the read head in the Ltipul consist* of all the input $ leading edges 
1. The parser can rxattum? any node atl of whose incoming edges are in the 
current head position- (Such a node ta said to be in the right /rings of 
ihe Lead position-) 










4-1 NtHi-Drtctttiiiiiftir Clmph 3^1 

■3-, Win’ll n parser wlioec rend head is na position p cauinini'i 1 a ehhU 11 n. its, 
rt'Bii Lend auHVes I<■ fi iicw posit inn \( cidmlak’il 1 iy taking p Ariel rep lac-tug 
n '* meanting Hge* liy its not# wig; uiics (We call ft On 1 tj-.nacees.vir of 
JJ The nude n. all cif whdHc i»ut^ciij-jj^ nlgo dire eluw in p r . is- suid hi tir i]] 
the left fnng-f, Eif ;/.} 

4 The parser cxaiEULie? imdc-g one at ft time until it rejw?1jov ft Load position 
with lie* nodes in its right fringe. 

The reader can verify thAf the example given above moots The h&ttv con¬ 
ditions. Some thought will also show tliat (i) a node- is mwer rend imtil «It 
its predecessors have been read, ansi £ii) this mrtltad, when Applied to any 
flow graph. eventually readi 1 all the nodus in that jrftph- 

It is worth noting thftt tjjj^. method, while phrased su as to anpiy to all 
K(fw graphs, de-s^rrib.i’v: exactly tile motion tif onr string parser's nvial head 
through its input. “string graph," The string ease simply make* elo use of 
the non-deTfrmLnisnj Inherent in step (2). 

Each time a graph parser examines a EEode, it passes three piece* of in- 
formation to the state transition functions of fts active reeogniaera; the typo 
o» the node read, irs left-linkage information (a set of port-edge pairs), and 
it* right-linkage information (another setji. As with out read-head motion 
rules, it is worth noting that this list describe in a general manner the exact 
information road by the head of a string parser. In the string case, however, 
the left-linkage and right-linkage information are both trivial; it is always 
the CAse that the only edge in the old head posit ion went into the node ‘a 
only input port, anr] dir only edge Ln the new head position came out af the 
node's otily output port. 

Flow Graph Racugnizera 

The right-hand sides of flow-grammar rules are flow graphs: thus, the recog¬ 
nizer* from which wo build our parser wlil he How graph recognizers. These 
reCdrgniEor* will receive type and linkage information about the input from 
the parser, and coEELpare- this information with that found in their targe* 
graph the right-hand side they we recognizing, Thcsr structure and ftrne- 
rion will be geuernlizAtions of thuae of their string counterparts: that is. they 
will be state machines which uiAko transition* luted on the input read. 
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* *> 
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ri.gi.up 4.1. A (CT-MEim-fiF. 



Figiirr 4.2. A graph gcncTm-rd by the giajiiimar of ■fipup 4.1. 


d.l.3 r States 


A state in a Jlow'gTfsph recognizer coirof pairs matching ntlgi^ in the 
recOginster'e target graph with edges in the p^irseT i current head position. 
For example. consider file (grammar of figure 4.t. and the graph 
by that giasiLEtiar sh*JWn in figure -3.2 At. some point in the pmc of this 
graph, the recognizer fur tllfi right-hand side of the A-mlc might reach the 
M Lowing state; 










■M iVi Tiidliiif }jr (t>ji jj h PiWM'r.i 




Wo have indicated rite parser's head position as in Ibc last serticnu the labels 
cn the mpuf-gmpll And tacfet-grajih otic's indicate Eho pairing which is the 
stniilt. The target-graph edge paired with A jjivcn Lflpi.it edge is called the 
(Arjjt iflMjr of that edgi- the latter is the input cmtijp of the fondar. 

It is Cuuvrxiinit (albeit. frdund&Tjtj to think of a state .IS having two 
parts. (i)4Kt of edge* from tlje target graph. and (ii| a 1 J correspondence 
botwoni that set and some of the edges in the parser's head position. In 
this View. It become* dearer that the states of our string rerognijer* had 
tho I3UJF composition; their edge scr was the edge denoted by their Earley 
dnt, and tbeir correspondence was always the trivial one sending that edge 
into the single edge in the parser's current, head position. The triviality of 
this correspondence allowed vt to Ignore it and i prec L -rjrl n that the states 
Of our string recognizers were completely determined by tbeir dor. position. 
We do not have this luxury in tbe graph case: for example. cxmiiiK the two 
states shown in figure 4.3, and consider which of these states sEiould begin 
a transition setjujenep Leading to an accepting state. 

4,1,4, State Transition Functions 

Tbe state transition functions of our graph recognizers take as inputs a 
recognizer state and tbe type and linkage information of an input node: 
they produce a new recognizer State as output. Recognizers operate in tbe 
exported mariner: they apply tbeir state transition functions to their current 
state and the information rdnrued by the parser's read head, and then make 
a transition to tbe new Stair returned by the transition fimrtion (if any). 

Tbe state transition function of a graph recc^lurer is best thought of as nn 
alsoril bm that prwnli in two steps; it hist determines whether a transition 
exists from the given state on the given input: if so. it then determiucs 
the state tljat tbe transition leads to. In other words, ihr algorithm first 
detenjunes the Accept ability of the input. and then it determine-* tbe correct 
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4.1 Nuu'Dvii'riwuixtif CJrupL Purwrn 





next state for its recognitor. 

Acceptability is determined by comparing the type and kftdhkage in- 
format-on of the input node read with that of the target graph node which 
coiTEapoads to it. More pftdiieljj fot s be the the current sstnit □, lot n be the 
input node read, let L be the set of input edges of ft, and let V be the set 
of target image* of L under s. If V conjirtfr of all the input edges of some 
target graph node n', if the type of ft' is the same as the type of rt, and if 
the port adjoined on n r by efldl edge in V is the same as the port adjoined 
by its itLpuf image (in £), then ft is snid to be dcccptftWr and n' is said to be 
its target imajt. Figure 4.4 shows examples of acceptable input situations; 
figure 4-5 shows some unacceptable ones. 

Once The acceptability of an input node has been determined. the new 
state to move to is computed by matching its: right‘linkage information 
against that of its target image. Mure precisely, let s, ft, tt', £., and V 
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n n .j 




(kirf&nj tlj^i ) 





-k\\ 


Fig-.-u^ 4.5. SciITK linnijrcL'pt.hblc 1 {state. uiuiiT.I pfcij* 
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FiyiiTf AG. New fatal*, input) pbJra computed hy Uir itatf-transidHin iJ B ndttnn 
from r]u- pair:- uT flpure 4.4 


be as above, let R be the output edges nf n, and Eft R' be the output edges 
of V. The new state j* computed by (i{ deleting frudL a all pairs involving 
edsea in E, and (ii) adding a new pair for each edge in /I. In stop (ii), the 
pair added for an edge e which leaves n from a pert p pairs it with the target 
grapli edse e 1 in R' which leaves n ! from p. {Since n and rt r have the same 
type and 1 ]]i3s the same port set*, this operation is wlMefiiled.) Figure 4,£> 
shews the (new-state. new-in put} pairs computed from tEte pairs of figure i.4 
by ting, procedure. Notice that state pairs not involving input edges tn the 
input node rood are uiudittcd, 

Am the reader may have noticed * this procedure agn-es with that used to 
determine the state transition functions of our string rccogtiiten hi fact, if 
We take into account bulb the nlge mapping implicit sit our string rcrognistcr 
Slates, and the linkage information implicitly read by the string parser read 
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FjgiiM 4.3. TJl« initial H tatc of the iub-tvcogniicr inmshed fitian the state cf Sg. 
um 4.7. 


head, this it tlie procedure uscd to compute the state transition functions 
iu our string parser. 

Linkage Mechanism 

Whenever a recognizer moves into a state whose edge sot contains mputi to a 
nonterminal. the pjuser will invoke a iub-rwofEtiiacr fur that non-terminal 
For esanipl-?. consider the grammar ruin] State shown in figure 4.7. Two of 
the target-graph edges in the state of (he $• recognizer are inputs to the 
non-terminal £T. so the p;iXHf'F calls a recognizer For B. giving it the initial 
state shown in figure 4 9, 

The initial state of the B rerogniacr has followed by ^transitivity' from 
the port-correspondence informalion iu the grammar rule for B In general, 
suppose recofniicr state 4 contains target edges f' —target inMgf 4 edges 
(j — w hirh -ire Inputs to A nun-terminal node H J , The parser delete^ any edge 
pair? from * which involve the /, chooses a prodttftian P which derives the 
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Fe[[litt 4.0, All lu rcpl *tate fur Ihc rer(igjEjl.Ef mvnkcd ill S^ept 4.S, Tina rule 
diould be reduced. 



t^pe of n J . and invokes a recognizer for t3(f right-hand sink- of P. Tho tnitial 
state V of this rnirogriiier will contain one pair for each edge e*. on follows: 
Suppose tj enters n* at pent p^, and 4Ltpponc port j/. is mapped by P to port 
Pi ™ ? ort n flO F’s light-hand sldt>. Then / will pair the leading [target} 
i-dgc entering n with * 2 (the input image of e'.ji, The reader is encouraged 
tt> verify that this procedure produces the state of figure 4.$. 

The operation dud to invocation of a sub-recognizd is the return of that 
sub-recogniser, hi the cxmiipk given above, the state of the- JJ-reeogntict 
after the parser reads node n will he. that given m figure 4 0. The edge set of 
this state contains a trailing edge, so the parser will reduce the recognized 
nil# and move the calling S-recngnirer into the State shiiwn in figure 4 10. Ln 
gnieral. whenever a state contains a targol-£r;*{:h trailing edge, (be parser 
will perform A reduction by adding edge pairs to the caller s state in a 
procedure which reviTses that used at invocation time. 

The reader must by no* be expecting the following claim: this lining* 
nicdiamsm is a germr-d phrasing of the exact rucehmiisiij used by the string 
parser It simply make explicit the manipulations. c.if chi' target-graph/iklpmt- 
graph edg# correspondence that were left implicit in ihc string case. 
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4.1-0- Flow Gr:iph. Parsers 

We luwfi now introduced tliH- Ihm 1 luwac 1'omptRiru.t* oF mr pnrtuT i-hiil- 
?i ruction lechuiijiie.- ■' iihi'Iumswui W rending tin- iuput L Ilie nTogutMT? fur 
LEulividiiSil mil's, Find Hie ImtaKr merhiiiiiiinj Mat'd to iiLtmiiiiiiirt miisriura 
for ditfcnlH mlfs. ItaHin than state a ro::i]i]c<e «>iisTnn-H<i]] iiH-riiunism 
[as wo dill iti tin- [trovii.ni? din.]ir i-r ). wo will in si end consider two crampli* of 
gpa^piiii.iT/gn-apl] pans and thr hcJb&V H If of itlO p[)rSVT CUUltT M 11" t o(L for them. 
Those examples will rjqntse some detail* of tlLO construct kHj «ld behavior 
cfthi 1 FOfliiltmg parser;* tjuit have not ImvU considered thus for- ici addition, 
they will introduce a ifprewntaLitni that Form? the basis for that ItScd by 
oar simulation aLguritliiHl. 

A Simple Example 

Let us start by considering the behavior of a parser corptmelod for the 


Following staple rrmunar; 

-S- ^ 

/ A \. 

~A- 


~ b — 

- 5 - 


— b — 


when run on the following graph; 




c 
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Tldf |snranr st;«rt* ujf by calling Has- m-L^mpier fur t]|c- rinHit-liiixid side of 
tin’ mb' deriving *’■ The parser stark tH imply. and its rend luail is over 
tin’ leading rtlge iif the input. Since ILctt is only me surh edsr. tJ,f purser 
11** JJ (1 cLmicr ut rietcrurmuig tin- ^rcrngutxrrs initial state: that is, tbefe 
is only unr p<w«ble i'ornwpctrjdeurc bctwivn the leading edges of t]je input 
iiLLd those of the ^-recognizer's target graph. (We cuiLujdrr below how to 
make this choice in general,] 

The initial Configuration of the parser is as follows: 



At this point, only one node in the input j* readable. Ah the parser’s read 
head reads and moves over it, its type and linkage information is used to 
[futke a state transition in the i'-iX-COgnizcr. Of course, if the state-transition 
algorithm determined the input to be unacceptable, the parser would stop 
and reject the input, in chi* however, the parser m*¥cs into the fob 
lowing configuration: 



Tilth state contains target edges which are input? to the non-terminals A 
and £1. The par.u-r t Ink# invokes aub-pecognLiers for these nodea. moving 
into the following configuration; 







The foi Lowing points arc Wtkflh EioT-ln(5- 


• Wr arc no lop ger using a simple si ftck to keep track of sub-recognitor calls. 
Because multiple rails may he made- from a single state, we ubc a “trtt- 
ahaped slack’ that keeps- track, fnr cadi call made. of both tliG calling 
state ami tile particular node being recognised in the caller's target graph, 


* This behavior appears different from that of the string IWOgmaef, which 
left Ml d£ai ley dot" in front of the node being derived, In fart h this dot 
Bcrved to identify the node being derived—a function now handled by 
information, Vpt on the stark -not as a slate marker. 


The parser is now ready to read another nude. Let lls say it reads n: this 
leaves it in the following configuration: 








•t J JVmj-i>(*h’j , rrimwJ ic frraph Fiuvrm 
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Thp iwogniser for A ha. 1 * now moved into an accepting state, so the parser 
tcdsjeeE the production invoivod by snoving i-n.bo this configuration; 



Ncrto that t he S-ncoRmer has changed state while its call to the iJ-recogoiier 
is outstanding. This routd never happen in the string parser, To emphasise 
this amiability of the state inform.ition stored in a graph parser's stack, we 
think Of the stored information as .tinfe eiy'rrte rather than states. 

Next, the fc-node is read, and the 0'recognizer changes state accordingly; 
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The Las im*' moved inlo Ail accepting state, » the parser 

redoceiE its- rule and moves into the following eaaiflgurfltiion: 



£l_ 




t — 


Notice that the S-recogniscr stale-pain derived from the reduction proce¬ 
dure are fiddoii to lhosf L>f its pnor state, Tliia additivity together wfrh the 
tree-shaped stack, allows multiple miiHiltaneoMH. calls to sub-recogmacFS. 

Finally, the parser read the m-node and moves into the following config¬ 
uration: 



The pann-V input has been completely read. Add its trailing edges arc in 
comspOtldeiice with all the trnihjsg edges of the S-rccoguiiieT s target graph- 
TLc pnf.ser accepts. 
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A CcinplH.'j[ Example* 

T]jf following example tltr behavior of fi parser wJm^* jyrpujj- 

HjJLr hUkI IVfu3'Ih™ 1 ujoE tLK|j nunliiiic hi produce "VtiiKgeTed iti vrM iLhknis jlilcI 
reductions.' Consider tIn; Billowing grammar: 








which derives the following 'graph; 



Unlike thf grammar considered in tilt* lasr example the start symbol far 
thtfl grammar has two inputs, wj the parser constructed froim it must snake 
.to me dt-terminatim as to which of cEid input graph "$ inputs rorrrsporjd to 
which of the start flymboTs inputs. In general, there is- no way (short, of 
trying each pnswbihty) that a parser e~.m determine which choice of cmre- 
spondenettS, if any. allows a parse. Titus, in our desnipliup of this parser 
f.aniL in OMr simulation algorithm), vre wilt assume tlint the input itself cost* 
taiiis a specification of one .such correspondence, am] the constructed parser 
wiJ] use that otie. ] 


'Btari* the aimiilutiwi dpurilLnj-,. tjlea htstb sniiunu and pjvpti a* bpuS, tli« ttTJiu [ra 
such, n spi i"fii-Atii>n OTP xv-ndily at hand. 
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lit 

Lft us trainin'. iJil-U- tha< Hjt inrwi’T for the above smuuuar slEirt* ill the 
fi.iil]4■vvilj}' Ci:Kufij(liral foil OU the alnrvr graph: 



Tin’ tf-r^ipnaer's slate fonrmns an input edge of the non-terminal A. so 
!hc activates a rtfOfBJMT Pur A and moves into the f(»]|i.rtwLtug eonfiE- 

uralitm; 



The? following pOLiltH are word? noting: 

* The parser Inis started the A-rrcogilizer before ]f. can detenmne an input* 
er3fj(? correspondence For all of A s inputs- lAf hen node til is and the 
parser determines a corn'spondencc for A : i other input, the ilew input 
will be added to the recogni jar'* (then-current) state. This process is 
failed jfaiiyet-cd iitreration-. 

* Only those pairs involving input tdges of .4 have been deleted from S t 
state. This “suhtrartivii}'" is dtlid to the additivity of the reduction 
profess. 

* Cnnfifinr&ticins which involve partial state*. such as. this one. will always 
Jesuit f rom afoatiuliS ill which the head image of a recogni jer’s state con¬ 
tains some but not all of a non-tenninal’s input edges. In these situations, 
the parser will invoke ft stth-recogmrcr for the non-terminal involved even 
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if tL<- input edgcsi rutlmpngujinK 1o +]j*' ruiip-terintriid'H, iiipr.Ll^ are md iu- 
] ,l,:i1si 1(5 Jl ill Ihe rif-Jit fringe (if rln- |mrwer’rf read head jnmititati, For 
nxmiliplt in Ihi-s eo^ figuration: 



a parser HfutiEd invoke a recogniier for B even though the node b is oat 
y*t eligible for reading, 

Tbe P««r » "»dy to read a node; let m 3 ay it reads the l node. It 
would racfr into the following cunfign ration: 



in which only tile n node is re.idaljte. giving: 












5(1 4 riic AJjj'hrffhm 

The other input to the |trf*vj'twii!=]y- iriVL»kL'il A-rerupracf Iul-i arrived. so rlw’ 
|STT^lt jilIlIs it Iih that [WoguiMT 1 'f sN'diN 



A ■careful twitler tuny Lave noticed that ws nave drag'll a two-way arrow b-t- 
twwi the A-rccugJIWcr and the node it van railed for. Tkh is to remind oh 
that the parser, in order to do this staggt'ml invocation, must kwp track not 
onfy of which node a rerOGUiaer was called, for, but also any recognizer that 
has already been railed for a Riven node. That is. ill addition to keying Te* 
turn pointers" with active recognizers. the parser must keep "calE pointers' 
with nun-terminal nodes that have subpreDgniEcrB active for them. 

The parser now read the node, leading to the following configuration; 



Thin situation is the- converse of one encountered earlier; instead of one 
(blit not nil) of Hie .4-recognizcr s input* having been leached. one (but not 
all! of its output have. Tho parser performs a kfapgcrcrf rciuctiim Himitar 
to the staggered invocation it performed ear her. and reacbi's ttie following 
configuration; 










■I 1 1 Nr/u-Di-ti'Tiiiiirhtif Graph Par hits 





The parser »a now ready lo read cither thf n- ut (In? i-node. ]>r aa say it 
chowes n, this leads to the following configuration: 



Flmlly, tilt parcel reads the l-noele and moves into this configuration; 



This ronfifiDpntSoti allows tin- completion erf the Staggered reduction started, 
Earlier, so the parser terminates the A recogniscr and adds to the state; of 
the ,?-recognizer. 
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This i - :s.:- ;ii rrprLug; configuration. 


4.2. Thfi Parsing Algorithm 

We arc m ready bo present, oiir flow graph parsing algorithm. The algo¬ 
rithm simulates the behavior of a non-dilenntMHtlc graph parser, exploring 
mTm iltAnsoiiaty ail the parser's iroehrible Configurations. As with the string 
algorithm of the 5ast chapter, it will be useful to i hi nit of the algorithm as 
simultafleouKly simulating a large number of graph parsers, each of winch 
eventually makes diifcriUJt ^uessea as to the derivation tree of the input. 


4.2, l, Preliminaries 

We introduce here an itenvbutd notation for the confijuntioilt of a graph 
parser. We will simulate ft given graph parscT by tori slnn 1 ting item lists, 
sinhlar to those of 1.ho Iftftt chapter, winch show the parser's configuration 
at each step of the input. 

The basic unit of tin; potation is a representation of ft state object called 
a stnffi hem [or just licjp). Items are composed of throe part?; a stare of a 
graph recognizer, a list- of pending calls to other items, anti a list of items 
to return to. In addition, item? will sometimes be annotated as deifd, and 
they will sometimes be marked with ftu R'ftiip- (Wo say more about these 
annolation* below.) As before, we represent the pollsters in call lists and 
return sets with integers, and we enbscri[il items With integers. yielding a 
representation liko this;. 

[{state), [call list), (return pointer)]y 

Using this representation, Wf can reprisonC the couflgnrat iot'L of ft graph 
parit-r by showing its rend head position in the iupnt and items for the 
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fllato object* i>f j 41 its- Tfrikj'tiisrrs- The i'orrospirt^ifiin.’ part of each state 
repress'd tiM jott will !«■ iudjcoj id by labeling tin- target and injHit edge* in¬ 
volved. For maniple. cel (lir first couple mu shown hiImw. the cutlfigumEinn 
obtained just ikflcr (hr iuvnM'Jitkm iff 11n- ,4- anil B-rLTtigNWT* rrui he giv^j 
4LS Follows: 



ts ^ j Ua ty c sd, 4 

[a^ %-b— kU, { 3-^1 

[e^ +b— , rvx } ] a 

(The subscripts used here are, of course. arbitrary.] 

We say that the parser's Mtiw tttuffniscr t [or active firms) are thast 
whose states are nopi-empty. ha (hr example above, only the ,4 and £f 
recogLiLMTH are arrive'; the $ rctO£MtfT is said to be suspended. 

When we wish to show the entire mil of a graph parser on a given input, 
we rap romprens the spare Used by showing, after each read operation, only 
those items are activo or Which marie a state transit inn For example, the 
run of a graph parser on the grammar and input giaptL shown above is shown 
in figure 4.11. 

While this depiction Of a parsr nan looks a lot like the pnrsi - lists of 
Earley's algorithm, there are some important difft.'TVJW'W. First„ jjot all active 
items in a given list change state when the next node is trad. Second, more 
than mir active i(ern in a given list ran represent rwngmuef* invoked hv a 
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jh:irif<T. In EsrleyV algorithm. twh arrive tlnm rppn-amtrd the <mly 
xwuglllttT nirnmljf art.jw fw a< Ujut l*i panwr 

4,2,2, Optimizations 

As wi- did wilh Earley’s algorithm, we will cuni euro tin:- items representing 
iwopiiseiK fur tilt same rule wliir.li were United At the saetbe Input po«ti™ 
and. are sn the same be ate; one item will fee used to represent the st ate object 
of all such recognizers. In urtlrr to accomplish tllis. we will be usj.ng the 
twt> cplinusitiobs-multiple-call collapsing and duplicate-item merging^ 
that were Ibtrodwcod in the .last chapter. 

Because the linkage mecLabi™* of graph parsers are more cnnrploX than 
those at string parsers, we must be more careful in applying optimizations. 
In particular. the presence of staggered invocations and reductions, and the 
fare that editing item i can change state while their coital are still active, 
lead to rases that require a very good undfiratandmg of the intent of the 
optimizations. Thus, rather than proceed directly with the statement of our 
parsing algorithm, u-r- will first consider some examples of its behavior. 


4,2-3, Examples 

In this ration vre ran the puling algorithm on five different grammar/graph 
P“” sample run exposes a different facet of the algorithm’s behavior; 
between them these examples cover all the caara that the algorithm handle 
?|Hxiatty. Having once understood ail five of these examples, readers should 
Etavc little difficulty understanding the complete statement of the algorithm 
which follows them. 

For each example, wr show a|] of the item fiats constructed by the al¬ 
gorithm. Each such list is followed by a some explanation of hew it was 
constructed. 
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4.2 TV ASfpmtliUi (y 

Example 1. 

TLun cctJLN||i|L' i'hiiihi 1 (ts (In.' L'tfc'fljH «[" *tato elmssj^ Lti Hip niller while ,1 ivilh 1 
“ it LLl JH'tiY:-. K i]]|r(nJlICi'K tfc|H’ h- 1.IL (HHT.Lt Ll Uj ttlVlfli^l ,Tt- 

conipli’tLmj t]]]jc which spills a siijjV railup jti-ut into twv 

Tilt 1 previon* pa*f* flkw* a ujrjuLLiLi iir. t]»- input frnpli derived liy tJjiit 
grajnnjar. jukI tlir item lift rcflftjuftfd by tin? smuiJ.TLtiu'ij before juiy nodes 
f.avc been rejicf. Nn-]JO[L-tcrn:LLiifi]i have 1 i-lxti predicted at this point. so rajjy 
£MJR Ltf'tn is necessary. 
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, ((S 2 3VA **■)), ? ] t 
%b- , *j., illj^ 

LS^ 1 — ( rv^-j 


[ 


A =*+<£>- ,^, fill. 
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■rf - T7j(‘ rrouq? AJjfurff/juj 

WtH* <In- Ibt aUiv trading tuniv ftj.. |t< m 1 nclivt w ike noJf narf; 
tlubt i*. Ltd state i'<iaitiuuL-Li iikiifeirttof UjjlI iitnk-. Tlir hihLh- wn* ncri-ptjibfo (n* 
;h T stI«mi 4.1.4). mtc) tEie iron El in* IriLtisilfon 1ms foil trn a state iimtaiuing 
^tt till’ [innj-tL'F]jji]jii]^ D EUJ(] A (The'[]" syujlnild minimi tfieedtfv t L 
-njii] cj ::: item 1 itnlLralc fSirit tlifttf' emigre were prt>fbt in fit,it item's state 
imuttreEuitely after tbe iijjmt wish- wan se&ntuVl, bar wm tfo'u deleted as a 
rasuit lJ the nub-nTioEJLLKT call ulrrljaruHm.) 

Only ube derivation dedifon is possible for the A-nt»U\ but two are 
posiiLbfo for the J3-rwJa. fiittiitively item 1 represents (be S^rwagiMci for 
two parsers. Eacil flits made a different derivation decision for B. but. both 
If main in tbosnme state and wore started at the same hi pul position. T]jt- S , 
we rrpraaenl both with. a single item and use the call list for B in that, item 
tn keep track of both uutstandnig rails. 
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4.3 The Jbuwjjf Algorithm ^7 

Nr?w wn rrad mule fin, Relit 4 wan tb' oitly one jlcI jvH.’ mi tliis node, *n 
it- fruiter bUL njipniprjfil'c trFinrat Llhj . l( , >t ^liLto tisvptiidtfll'iai fmvhot.ing 

|]ic two fi-noitm lij invoking .ijn ifiriiLr r nih-rtwijpiljt^: thiu happen* i:i a 
profi^H ejou-lly like that hii-h in 1]jc Iasi Ibr. Items 5. 0. 7. ajjc] S pure the 
CDfliiit; notice that although The reCftfuiaTH far Elti- upper ami Ihiwht E-nodes 
bttluj started mi elm,- same li/t. they are nut started ,%( Hie same input 
portion for the purposes of multiple-rail cdlapsing. 

Rpms ? ami 3 are on this list Wap*?, while they were not strive on 
thp node pe.id. rltey arc active cm a node eligible to be road. This copying- 
forward of active item/ insures (bat. cacti time a nmio :s read. a|] ihc items 
active OIL that node will be present on the previous tUt. Thus, we never have 
to search back, through prior Lists for active Items. 
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■J.? The Algorithm 


C3 

N< iw the Tiler begins. We rctwl tunic Aj And item S moves into wl accepting 
dafe. Wr rna mm e^h-tv node flj ,,f Hem 4 by letting Hl-iu b n-tum. 
l]"f n-r-nll Hint iN-rn 4 represent* Iwti roL-iijjimers: one which prccllrr l-lI J3 l 
via ihiu 5 arid him- which pn-dirp-d D L via item G- If We innhe ibe *m\r 
transition ip item 4 called fi»r by the return of item 5. we wii! Eiave made pi 
s|™™ns Iraunitien jp the rrropurer which called ft. 

Tlw mbit ion is To c-split ilont 4 into Ltirtu 0. Tills prornas separates into 

ilfuj? [Eli-. representation of the two jwqpiiit-n wliere WCtd merged in 
item 4, It works by; 

1 Copying item 4 to the new Lte:n 0. ( rids pves us tivn iff ms each cnF which 
represent both of tlte pecognlacrs merged in item 4.) 

-■ Removing tin- call to item 5 from item 3. removing Hie cal! to item 6 
from item 4, and removing the return I* item -1 hy item G. (This make* 
eaeh of item 4 and item 3 represent only one of the two rerognlwrn ttiat 
were merged in item 4-) 

3. Going through all the callneii of item 9 and infor ming them abcust their 
caller. [This kftpa the call list of item 9 and the return sets of its 
c allocs consistent.) 

•4- Guing through all Ore callers of item & and informing them of their new 
Calk-c. (This keep* the return set of item 9 and the rail lists of its taltera 
consistent.) 

The effects of the ■C-wplit operation can be seen in itema 1, 4, G, 7, 3, and 9 
of the current list; once the c-spEil is complete, item 5 returns to item 4 as 
described in section 4.1.5. 

Note that items 2 and 3, which have been brought forward to thia list 
because they are active, are unaffected E?y the c-spiit. In general, nope of 
the ‘Siblings' of a c-split item arc affected by that split; only its ^parents’ 
(calh.-rs) and 'children' (caJleea) are affected, 
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4- TJjc jUwuriflj'Jii 7 ] 

J^cmliLLi' ucjcJe Uf juatu itH'itL ^ it! ;«j <u t-pplhig state. TElLp c-spljr* hcin 4 
iij(i.» item Ell :i,tiil ilrm [} into mill ll for the siljhc rramn* jw jtiuj & o 
split iiL'in >1 m the hut ]jrtt. i«a]y chi* tittu' jt i* ftn- 3? e In^r hn* <>[Eter 
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-<1%-, ^ «■), 11, til], 

U^-<^>-, (ft, tl^rtVv**],. 
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[a* -<l[>- , ft fi.«^], 

[g ^ -b+ r b- , rv^ 1 

[fi^ -b^b - , ^, ] a 

Example 1, but 5. 







4.2 Tho Ptifititif; Algorithm ^ 

N"* wr nnut n™\r fr s , Item* 3 mid 3 rluuiffl 1 rtntr. juut ifrui 2 V whim 
o^pHtu ilom 1 into itiiu IS. Item* 4. 0. 1EI :uni II arc jiffwt^l hy [ W split. 
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4- The PhrriliK Algorithm 

We Ifrnd ^a, JLHi] the shale ethi 1 1 Ilf spurinHI? piusi'n IS. Itr Jjjn A dun] 1(1 
an. 1Ulivr on tjjt- tiude j«ul hut it is nor jin-fptable. *n rliL-tr wupiHcre re- 
j:irt, Wr indicate Huh by marking tEuw item* a* rfrnuf. a sin’ll wliirli wri* nut 

lUTPiwiiry ill i-Lh’ string ease, The poim here i* tbit. ... the 

vrs rc’iiroMiiird by tlirar itrnis h aw rejected. (hey may have pending tails 
to iitlKT twogisirer*. If tiling «lhiT ircoi'iijjberf with- allowed it, if turn to 
tlsc'ir dead caller* , tiuCep ret lints might causa* state transitions which lean] to 
spurious parses. By marking the items for irjeftiiij recognizer* with rficad. 
Ul -' w: - know !r> suppress future return.* to those itemi. 

Reading b 3 also pots ik-ui ti into an accepting state, but its return to 
items 9 ami 11 docs not cnnac th«n to c-spilf beemua diev [Law no other 
recognizers pending for the U L node, that item & Completed.' 

Items 1, 3 . and 5 arc copied unchanged from the previous Est because 
they bk active. Note that item «, although it contain* item 10 m ita return 
Egt : is unchanged hy the fact that item 10 ha* died. If item & were ever to 
move into an acceptjug state, its return to item 10 would simply he ignored. 
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■3 - TJic Aifpirithia 




WV timV t![. Itnns 3 4Lit>.l 1J die-. Itinn 3 letuvcs inlti rm artrpHijjr 
Jifrilr, '-mining iliuin 1 and 12 to f-tplir Lulu ileum 13 ami .3-1. Hi]* tpJit 
Kalav. ijIfmt cv™ (kmij'h anmo of tin 1 p'-iidiuK rid]* frir the .d-it-mlc roi»|)6t'ti\J 
% il(i]ii 0 arc Itt lm- if tint; tl >0 dcrkkn wfcrtlu'r rn no! to r-sjulit it nuuLe 
on rLo bjwjt ■ »f iitMuher inf jH-nding caEIn On fJio nthi-i IjjiihI. bwan^e 
ItniW 4- 10- r«j<] 11 Fire iliinL (In 1 updat lui; uf tkoir rctun• sot* iu■ i i.'l! | v Jono 
by the [-■splits uT items 1 and 12 arc suppressed. 
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4 i 1 T3 k' Phrsfrjg- jtjl-v^rrdajjj ^ 

We n-iid jussSc «:n. Itrm i. vrhWh is n C^IotcI it rlUl hiuwh into m nr, 
c^'ptiiig; iinti‘ (tatf iurhidrri Ml ^ ifn tnuEmff ni^: Ibc input ivrrfrptrd. 
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4.2 Tiir Rirwm£ AJtfufifhjjj 
ExampEe- 2 


TElls rxmivlv vxt&ms the initio.* :,f mnhipl, HNill rdUfwmg ami *r ilfr _ 
1'iTCit ijjVm(FiHit]j. If iiatn^iMrcx tin’ fi-.tjjX e f (tpL.ratii]|i, in wliirh itu itn 
sj»|jf into two tfciiLH as t||f Hunif of ji jm^lictiniit ^MTntiiin, 

l^c sfarf ujf tvitli jus( two ihuiis^ mtr foir aar-li drri™tiwti of S. 


'Ill is 
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4.3 77k P.-ir^iu" Aidant Inn g 

XTprm nindiu]; tnw^* u i , tuitli .V-n'rtij'iiiiitm Uj^ikc trraasilitnjj* itltu a riatv 
nuitniidui; AIL 111 ]Hit caF A. Si]ic’£' Tiju iwu ifrupibUTH n|pw ;l« Ll» wliids input 
is isipnl ri» ■^■l m< Ll purr uif ,4, Iiml1iplu-ni]l ndljipniug tnkre plruv nja] ttlv 
41-rilTli.jriLLKlTn illVuh'tl W j] | UfK']] rrt ilHl t(L ljUfll 
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4-2 The Piu^iiejr AJ’^fjrirJjiu 

Wo nunl mn|r %. fUj H j Ipiptli ^-rmipijacn- Jiinkr iippruprinlt: 
T]j( f iti'liiH [hr tli*' .V-jw-Hgjiizcirg ;tro arrive iiudutjigod.. 
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transitu Hid, 
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4.2 Tin- Purmig Al&itithiu 




W4fn wp H‘d nude the HV-rerognizHTT id I nitw into a jJtAte 
re mt railing iIn- irtlici input *\f A. This nTt^ni/iT wifi }vu# tliis i now input, 
down Nj 43at- .■‘t-rLM'Hj^jji^i'rs of at™w ,1 and ■!, tup (Ikw UrniH njso n'prrwiLt 
imwk-tl by item 2. whirl] due* mO want to [lit** il^iwti (his mth.hk] 

input. 

This situation is ouuipilfliK'llt&ry fo that a:: which nr -r-Bplit a eidler, 
and I lie solution sh also eoinpkmciiC-ary; we p-spljt five caller. By this we 
mean wp spiff the represent ations of the two i-eecjgiiizcrs merged in item 3 
anion;* two itetiis, and wr Jo cite same with jti -eel A- Each of these p-^ptita is 
accomplished similarly, fur item 3 we Jo it by; 

1 , Copying ifeni 3 to item 5 - (This givers ub two items. park represent sag a 
recognizer invoked by two parsers,) 

2 Removing item 3’s return to item 2, item 5'a return to item 1, and item 2'e 
ceJ] of item 3. (Tilts makes efich of the sterna represent a rctoEimer 
invoked by ju#t one of the two parsera j 

In the general esse- items 3 and 4 might have had outstanding calls, in 
which case we would have made their cailees return to both them and their 
P’Spht*- 

The result Of the p-spEit IB that we can new pass down the new input 
from item 1 to items 3 and A without hurting the recognizers invoked by 
it£Dt 2, Thus, we arc ready to read the nest Bode. 


i Tin- Ai&irithni 


Hi 


5 







(inwti'c^-. Ci. ’i 





r jrt -fcl 


A — 


(lA ? i'ii f 1}]^ 



Example 2, list 4 







4-3 Jfir Pf-u-sijj^ Aiiifnithin gy 

Wl- rnvi iiixlr 6g. It.in 3 dice rxptrrh^ n v. jitjh] itnii 4 m4(e* m normal 
li,nto ^HMisiltcui. [teui 2 ciu.vcs into n jMjKc rtmUuMiug it* ,4-jjmk’'* 
iJiimf: tin* in pul rnii be pant'd down to item* & nnd Cl wirljiml ]^ri|j]ittijjg 
tJjejjj IwaiiM' they Law mo otJuf oiDm-. 


DO 


J TV 
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Wf rvfrd fJj(‘ finrJ rf. Jfe-Jjj & <Iie* «-xT>«H.-lipng n h, wljjU- jT4-m^ 4 ,Hid 5 nww 
hiUf arrcpling sUJnt. They Ujimj rehnni r« iu~ma 1 «ud 2. hull, of wtoida 
JUTCpt. 
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4.2 Tht- Porn in# 

Example 3, 

Tin? coc jle££|)3l' (Icjin.nigfrEiti^ idJtfijpTcd n'diurtiun. Nu new nptmthirLii .ipr 
mtrrulnrril. 

Tile fir^r Eiift ntarfcH wit]) Ui-tiLK for twu oltc-rilAE^ Ji-rproeuiWir*. Both 
t)f thr-st- nxctfrwrA'-T* «rpn ‘t mi A at H| f Minr point iu the input, no two 
^■rcnipjiaere Arc iimikH and butU wili return tu but]] tf-rrcu-flluters. 
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Nodf rii i? rend. tauLlng itom 4 ilifo jiel rurrpptjitg state for i]j«> ei1^p<- ^ 
Its ri'timi flUlH 1 # INujih 1 Jbtect ? to c-rnpht into ii™is & run] i 1 . Nnlkc that, 
illtfmugh itrru A Etas ntumrcl tnw iuf its out puts, it tckijumh iii Hit rail list* 
ctf itss CEilkTH. It will In- itiirwwl <mjy wEn-ti il n'tnnis 41 nf its tmtjmts. 
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4.2 m ■ Pafttfuj? ATflnrifJjiti 

fr, is iml. ]<™lmj; it™ s ixjt<I juk afrrfjJsiLS Hfjite n[ Hu* ^g, 

Il ™“ 5 1111,1 6 3l '^ out U- fiufi- ttM'y Lnvc no obIht < nibs jMTidijJg fur 
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4.2 TjV T'nrting Algorithm 


00 


NinN'/fj ssh’jmI, kitlans iU'ttl J Vfhiftl exerting fi r. Ir^EttH 2. 5. nihl G 
iil] Minin' state (riUJiiitimiM: iMri* 3 iitxl 4 arc nudiiu^fl. 
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T!ii-< Mtample explain ruj iutiTJirrii;Bj lielwcrii Ufa Kip-ml rrthirJion juj<] [(tip. 
liiiife-ift'Lii truT^illif wltir]] tLo k'juW .may Ltin 1 after seeing tlje 

ppp^imw ffliFLiuple. No i ih’-w ihj MTral dcct^ are ititn'nlunil, 

W'o start by pmlirring Hie A*a odr in Tbe S-h-cognizer ju all p !hiH ible 
Ways. 
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ih.'in 3 aiH>vre iklu 4 into the stuiK’ ^1 «itr- ns itriu 1, *n it i* into 

rluLt Lt f'lit. 

A, [Kijjit wiirtli not jnjj liilf id that only ifruj* w]urlt wen 1 tirigiEudly c-ijdits 
uf rarli -utljOT i'All eviT ho uitTJJ^J- Thin ia htH'JUL!<i> e-.-fjLi.ttinjj is the only way 
to got (wo iurns wllidl rcprroeiit tho sam.0 KtOgJimT .-*t apt oil at the; same! 
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Hf.-nlin^ node & t mem** item 2 (1ml not ifouj 3) ujfu a *lati-«m>ptutg ^ 
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4.2 Tin-Panting Algnrithiu U3 

Example 5 

Our lust cvunpic Lis tnir UHwt CninpIcK mji'. ]] dnjKKLHtjMUcH left nvMrnioq, 

' UH I intnuliHTK tk- r-ujw'ttiHoii. Stj^gcm] iiivutvifiutiH ami mlnrtinM 

art' Ojfcjwu in for jjrMn] HH'FisnrD. 

Tljiu^ Heart out amply rutHigh. a* wr Invoke n rwo.Rujzvr for *, 
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INsulhig ]ii>r[r f|j Uht-Vh 1 * J3ic i^Twofpam'r nitu a stale whii* 1 it. mind predict 
one the S-uatlr's inputs. Multiple-ad I mlJaprtitlg hupEicli* as l( did ]n the 
string cahp, wjfl; Wli iIl ium J. and H item 2 ff..nr tLi<- mni-recursive 

ffpaumillQ nf 4- Unlike I III 1 Hiring i^lsc\ item ?, ikies not cXfilLrif.ly 

call itself recursively: instead, Lc is unir-taxl with tin 1 

IJutl- arc the iiitiutdoiu behind thin nutrkrr: If we dirade by 'S' ait S- 
rorogn i hit. by .4,, a nun-ivcursjvie ^-rf^ojIlWT, and by A, a recursive A- 
recognizer. then the ^EUiilaLioii is currently rf|an™iting an. infinite mimbw 
■of parsers. each with one of the fuLtowilfig fail structures; 


S 

S —* -4* —» An 
S -4 A w -» Ar — A B 

i> v At * . ■. i " At f Ah, ■ 


The aLmidat loe dees this by keeping just the two structures 

S Af —f A* 

(and it shares the A arid A n between the two). The the E-flag an item 3 
Indicates that it is the recursive A-raogmxrr which. is being used to encode 
the infinite sequence 1 of such recuguisers present in the unoptiuuzed case. 
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No<](‘ hj is rviuL running I]jc iH«j‘nTiiraTC A^rreogHizcT Iru niiike n HlJire 
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" is ii mlr <itw\ Nolle Ppj j? nvwl. iiHnwtuft item 1 to jhluh ilown rhr 
i»tln-r input of its X-ellpiI-i' tct ilcniH 2 ami 2. Tlii* ftrsl p-splits item 2 i]jl 4 > 
iti’cci 4. Wjiiph* item 2 in nWt culled liy item 5 and tJie derision hi [ewplit is 
eluuIi' sin the (wwi* (if munlier i»f I'dloro, [ml on wMIlcr tLi-y jitter as 

to ivIhIhs) inputf. But when item 1 iumse* tin: new input to item 2 njitl itcnt 2 
IP* 1 * tn pn*H it tH3 to item 4, *ii,r]j m .wrtkia] would 11 M^fcc*- item 4 and item 2 
t-dli on ilio sbijjc njeognijer at the- same pumt, so rmL|ri|)lr-CiT,Ll rotlupsiriK 
arts by rcdiiwtiug item 3’si fall to itnn 2 uistejid of item 4 . TIlLsi in rum 
remove* the- last return pointer from item 4 ■ an it i* ujarked ns dead, The 
apt effort ia to (rmTHVt.ly) k(rp item 1 and item 3 tuif-h calling Ltoni 2 for lilt 
rmn-n'E-LLfsive expauftkai uf t]j(!ir .4-nodes. 
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m 


Heading tio-de P| move* 1 ]jc imai-FC’nindvr rer'eigitij’ier fi»r A (item 2| into 
cLri atxrp fin g state. This cause* item 1 top-split its i L.-itti'x] into 5. Item 3. 

however, fliH'rt (Uj f-split into item ft. whir]] mean* il dupe a normal e-sptit 
tilt Mu ii |u*os its r-flag and park* up its [ijilir image as a caller. 

(luce again, let u* Juoic. at the intuition underlying this action, If we 
flag a recognizer that lias returned with an asterisk. and a recognizer tllftl 
has made a state transition as the result of a return with a prime., then the 
paraors being simulated now have one of the following fall Structures! 



s - a, - . -* a, - X - *c 


The simulator now represents the** 1 structure* using the foil'.wing three 

structures 

< 



where item J is s\ item 2 ia 4„, item 5 Ls S, item 3 is Al, did item 6—the 
r-splii of item 3—is the A, recognizer flagged as the representative of the 
infinite chain. A aiinpit 1 c-split of item 3 would have been insufficient to 
build this Pew Structure because it would have made items 3 and 6 sihlingB. 
instead of child and parent. In addition, it would not have correctly marked 
item 6 as the A T recognizer instead of item 3 
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Afler TL'iuiiijjj thu iLt'xt ('-iliilIh'. HiA’ wIis^Li' prnernst luLjip^ijs Jignau, 

Tho siiuiliitiinj i* 3 Ilsw kc^^Ltin i lb*,' fuHowjijK s^rn«rlitr^-: 


f’ r - 

s’ — a'; ->, 4 ; 
s X - a'; - A m n 
s - a, - a; - K ^ a;. 


Tin* reader should be- sure he understands bow this structure was attained! 
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WLtll t]j( L mulihg of Hm1« L ifn;, f]]C blltUHII finally bl.'l'HjS Nt fCJILH' uif hli-r 
stack. The 4nm]flli(IO i]pw f-iHitaina tbe following atmetnrr 

S 1 -* A\' 

s - a\ - a*: 

$ - ,4 r -• A r r - A’;. 

which JiffirTs from that oC the Iasi list in that all the noil-reoirKiv'P A- 
recognizers have gone away. The reader should contidcr what the structure 
WW3)4 twve been if We had read another c node and started another level of 
recursion. 
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H33 

Tfeu- iitAi k imwiiiifc imcrtiuT Irvct. TJjf fiiwfl fflxiJigiiratjtsu k^at ]aj rh< - 
aqtwilMiw is: 


$ —* A). f i l i'iiL 7 —» itriBL 0) 

S A r -* A\ (if cm 7 — * it chi fi -* item 0). 
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4 The Algorithm 


4.2,4. Algorithm Description 

We air imw ready ■ pfrji.tr onr How graph parsing algorithm, Tin- ftlgtwithin 
tabes as input a tli iw grammar and ii Enw g;rn.g>ti: it delrrminnl whether 
the graph is generated by the grammar. As with our version of Earley 1 * 
algorithm. llis- cm it pi it of Liu? algorithm is a sOtim-uce of item ILhIh— one for 
each node in the input- which represenl all the pnaiibU? configurations of 
a nou-dpternimistic graptl parser when, pm on char, input., The algorithm 
Joes not output a parse tftt for the input , although if tail be modified to 
Jo ito in. -A manure similar t« that presented in the last chapter. 

The alpiTitlim operates liy using a list of items f, to keep track of alt 
the configuration* a parser might be in after reading the Erst i nodes it 
chooses to read- Given Lists / n . ... , li .. L , tbe algorithm constructs list J, 
by using three operations: a Acanntr operation, a predictor operation, and 
a cempJcfcr uptTUtion. These operation* in turn tl*e three sub-operations- 
the p-jphi. tiie c-split, and the r-spiif. We first describe the nature of ail 
these operations, and then how the algorithm uses thepi to construct the 
lists Jo, J|, . ,., /*, 

The P-Split Operation 

The p-split operation takes as input .an item i\ a non-terminal iiChde n which 
i is deriving, a item c winch has called t, and a list Ij, It performs the 
following actions: 

I It creates a new item whose slate port is that of i, whose call List is 
that of t. Mid whose return art is that of t except that c is removed, 

2. It adds T fro Ij, 

3. It goes through the live tallies of i and acids i J to each of their return 
Sets. 

4. It goes through all the live callers of i except c ami replaces their calls 
to i by culls to t J . 

&. It changes i ! a return set to be the singleton {e}. 

Itemj i and i' are said In be jyspJ'tfiof earh other, This relation is transitive— 
any other Pi -splits of t wo p (-splits of T {ijud vice versa}—but does not 
persist across lists- a p ; -split of i is not a Pfsplit of t for i £ 3 , 
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The C-Split Optratjan 

The c-split operation takes. ns input an item u n ncui4rvHuiijd node n in 
t"s kurget pn|ib. an item c which t Iia* c nJ]t-<3 to derive n. and a li»t I } . It 
performs tin? following actions: 

1 . It erenlrs 4 lifW item i* whose state par! in thftl of 1. whose return list in 
that of i. and whose coll List that of t except tltft e is removed front the 
faflcTa foi: ft. 

2. It adds t J to Jj. 

3. It gen's through the live chtIIctj of i and adds i J to any call list on width 
t appear#. 

4 Tt goes through all the live radioes that t h&s pending for nodes, other 
than n and adds t r bo each of tiieir return sets 

5 It goes through all the live caJlefij other than c that t has pending for n 
and replaces e by i J in their Mufti arts. 

G. It makes c the onEy fallen for n in li 

The Items i and c 1 arc said to be c-split/t of each other. This relation is 
r!■:■.■ ■■ iriv.■- r.]]v other c-splits of i are c -splits nf f and vice versa and Lt 
persists across lists: a c-spht of : created on A list /■, a c-split of all those 
created on other lists. 

The R-Split Operation 

The r-spht operation takes the ^ilJc inputs 1, n t c, / s as the c-spljt.. It first 
performs aosplit operation to produce an hem on list iy and then Hakes 
the following actions: 

l. It marks I* with the R'fiag, 

2- It removes the R-flag frotu i. 

3 It adds i to the call List of ft in t\ and adds t J to the return set of i. 


Tlie Scantier Operation 

The Scantier operation takes is input an item t from Eist f^.j and ihe j-th 
input node to be read ?ij. Let a be the State port of i. If a is empty (i is 
suspended), the scanner does nntjiing. If * i* 11011 -empty, but none ofkg pairs 
contain edges winch are inputs of Jij, then tJie seamier adds i unchanged to 
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1Z2 

lisr t y If ,h due* rcmtniu kttjml H- n ? - but n-j isdrttr mim'dto hv nn*cr*ptaMe 
iin djos-fibcd section 4 1.4. Tli«' aennncr mark* i a* Jhtri Atld :llIlLh it to Linl 
Filially. if tt ? Lh ftftvptaMc to a, lh< jh-hiiiit (i) compute* n Hew ntntc / 
a# LU^rribtH.1 i:u yertimj 1.1.4. changt'* the *1 ate purl iff 2 to V, and AlLi!.h i 1o 

liWt Jy 

Til* Predictor 

The pTcrhc for Hjperfitvoi] takes ns input All item i from list f JL Let n It* the 
sit At* part oft. L* none of thfi target edges of J art' inputs to ouai-trtHliHJils, 
the predictor dors nothing. Otherwise, for each rK'ffi-tttmitial llchIp ji which 
ha* Oft* or more input edge* in ft, the predictor diiilifjgmdjeH two cages: 

Cajo (i) The item i already has- calls ponding for n. 

Lot i'i, be (Ilf Eive items t has called for n. Then for each Eti* 

predictor does the follow ing. 

I, If i* lias callera besides i. the predator invulcrs the p-split operation 
on tjf, rt. t, and Jy. 

2- L*( fljt be the stale gotten by augmenting ii's current state in actcr- 
Hjance with the calling conventions of section 41.5. If the predictor 
h.44 already added a p 7 -split i' of it with atate-port *jt U > Ij, then the 
predictor adds i to the call List of t r and replaces it by i' on the call 
lint for n in i. Otherwise, the predictor changes the State of it to he 
jjj. and fiddfl jt to hat Z,. 

{iV.JSr. The stein i* referred to above may not still he in state s* when 
eea return hat is modified, since predictions occurring between this one 
and the one that added a" may have modified the state of i 1 In aUch 
A case, the predictor ftilt miaea i’ J rather than create a now item.) 

Case (iij The item t haa no calls pending for n. 

Let Pi be the type of u, lot It* .be all the recognitor* for 

grammar rules which derive JV, and Let sj 1 . ij,.. r, tfjj, be the initial StAtefl 
of those recognizers computed as per section 4-1.5. For each if the 
predictor has already added ii new item t' with state part to list I 7 , 
the predictor adds i* to the call list- for n In i and adds i to the return act 
of f r . Otherwise. the predictor creates an item with state part sf, empty 
call Itat n and return set {i}; if this item is for a left-recursive rule the 
predictor tparka it with the R-fUg. The predictor them adds this item to 
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m 

Ij and to the 1 call lii-.r for n Ln t. 

The point mado alum 1 alurit pwiJihlc changes in tlie tfatc of the 
itraiH i f also applies in this w-,] 

The Curnpletvr 

Thucompktrir operation take* as input jul item out list Let a he the state 
part of i- If none of tin* target edges in s are trailing i*dgc-s. the completer 
op writ ion does nothing. Other wise, let ti, r , i*t be (lie live members of t’& 
return set. Let n* be the non-terminal in ij whow call List contains a', and 
let c* he that cnll list. Fin Ally. let ijt bt (lie SIaIp of f* induced hy j’j return 
as per section 4.1-5- The completer performs the following .actions for each 
iy. 

1. If Ej it marked with the R-tiagt the COmpkter invokes, the r-split op«TAtiau 
on a*, ft, i, and If- 

2. If n has calls other than the one to i pending for node n, the completer 
invokes: the c-sptit operation on t±, n. t n and I- 

3. IF the completer has already added to It a o split j f oft* ■whose state part 
is at and who has calls outstanding for the same nodes as i* does. 4 the 
completer marks i| as dead (from & merge} and adds it to I } . Otherwise, 
the completer changes the state of it to be a* and adds it to- Ij. 

{N.E As in the predictor, the item a' r mentioned above may not still be in 
state st at the time of the current completion, Intervening completions 
may have changed t f1 s state, but the completer stilE marks i* as dead.) 


The Algorithm 

Ftrst, we constrict /q as follows: 

1. For each rule P* in the grammar which derive S t kt j| he the initial state 
of a recognizer for that mlr computed in accordance with section 4.1.5 
and the initial linkage information Specified in the input. Add an item 

J Tlil! rest ricliuu no caJb merely iedrcts the Fact that, mil ike thr elate <J jLriu; if-pais. the 
■■:■( irrtkpli items doer not retlec! which mjo-trTTnionJfi n tv h#iufi dvirtrd. Thun. when 
CCi0hii.1crbj.it whoditr to oieigjr ginr|ili Etnn», tbit part oF their 'et^tr' uuljI be chrcied 
Hi-l.mrMh-l; Ne'e that only which LK'iirn have outstAjjiliiLg. eallh ] sustain litre, not Che 
item* to which tLtwe caJIn were made. 
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to /,i wli< 3 !U- state pari is .* t , whLKit' calI list is nuirty. and whose return 
set is empty. 

2. Run the predictor m every ihru in JV If fadds m^w ilcins In fo. n]n 
tlw predictor mi them, and in^cai this ppires* until no urtf itHIM are 
adiltt). 

Next, Wtl sufrciiSLvdy CuDItrutt li, ... t J n - {liven fp, - - -t Jj - li wp construct 

J ? as fotiwWS- 

3. Choose fuj input node n 2 to read next. (This node mum he in, the right 
Jxlxl "0 of till! current read head,) 

4. Rim the scanner over every item in /j-j, 

5. Run the completer uver every item in I 2 ■ If thi* adds new items to I } , ran 
tie completer over them, and repeat this until 310 new items are added, 

S. Run the predictor river every item in I y If th±B adds new items to I in run 
tkw predictor over them, and repeat tins until HO pew itemE arc added. 
A little thought will convince the reader that tlua algorithm produce the 
lists given in the examples above. A graph is accepted hj this algorithm 
if I n coutailtfl an item whose «11 list-i and return set are empty and whoso 
state part is atl accepting state of 0 recognizer for a rale deriving §. 

This algorithm can he converted to produce a pone using techniques 
exactly Like those presented in the last chapter. 


Chapter 5* 


Discussion 


fri this chapter, wc discuss a variety of issues related to flow graph*, fluw 
grammars, and cur pursing algorithm- Wo include a complexity analysis of 
the algorithm and same suggestions for related research. 

5-1, Flow Graphsi. and Grammars 

As was mentioned in the introduction, flow graphs were abitfacted from pro¬ 
gram descriptions called plans The goal of the abstraction was to preserve 
two structural features of plans; {i} the partial ordering of operations, and 
(ii) the naming of inputs and outputs. There were a number of structural 
features of plans chat were left out of flow graphs, most notably *(an cut 11 — 
the use- of an operation's single output as the Input of more than one other 
operation. The criteria used to determine which features of plans would be 
preserved in flow graphs grew out of the author's wort m program analysis 
and arc not germane here.; however, We say more below about how graphic 
representations which include Otln-r features may be usefully manipulated 
by our parsing algorithm.. 

It should be quite clear from the above that the structure of flow graphs 
and flow grammars were developed without milch regard for graph-theoretic 
eoaicrrus. Till? does not necessarily mean, however. that they are devoid of 
theoretical Interest, if we view flow grammars as ^NffnjiMtioilS «if string 
grammars which generate partially* as opposed to totally-ordered sentences, 
then the following sorts of questions naturally arise: 

• 3s there a natural definition of * “finite-state flow-graph autoinalou"? 

Is it possible to develop a hierarchy of $Uch automata analogous to tie 
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irtrmg-iuitoHiiLtik lorran-L^ WJ,£lt Ia tk‘ rt'La*iounLip Iwtwnsi this hier¬ 
archy and tlu' string IdieraTcljy? 

* la is piiHwibk' to develop a liii'rnrrby t'>f flow grammars Mtalpgunm to 
Clmrm&y * type ft 3 string-grammar liirriurrljy^ Li particular mv there 
cajJuuird-ranB faults for Jkfflf grammars. and tlo tie sotR of languages 
generated by surll grammars satisfy any knfcnreRtiiig closure pruptTtirt? 

• If t^kc- answers to the above- questions are affirmative, can we relate the 
automaton and grammarhierareldeft in a manner rcmiuiiMllt of the Bering 
case? 

CHir research into flow-graph parsing. ns might be surmised friutt the refer¬ 
ences mentioned iit chapter 1, was initially concerned with questions such 
as these We hoped initially that Bow-graph posing might he reducible to 
content-free string parsing. White wo eventually gave up on adtieviltf such 
a direct connection between the two we believe that flow grammars 
have a strictly greater .generative capacity than String grammars the intu¬ 
itions we developed La the course of this research seem to indicated Strongly 
that the answers to the q-jculioits given above are generally affirmative. 


5-2* Applicability of the Algorithm 

One of the most uitoreating features of our parsing algorithm is its amenabil¬ 
ity to ’advice’ from outside sources of knowledge Since the algorithm s con¬ 
trol mechammn work* by consulting and updating and explicit agenda—the 
current stem list—it Ls A relatively easy matter for external agents to control 
or influence the algorithm^ behavior: they need only make alterations in 
this list, 

For example, let 11 s consider the faii-out problem mentioned above. Fig¬ 
ure 5,1 shows a grammar fragment and a pseudo-flow graph which contain* 
fan-out. This- figure represents the result of a typical program optimiration 
andi may be road aa follows: 

A Arid B are iliEh-levH (ipmUrucu 1 , A Piny l?r iUtplcilLHttrd 
by (jpcvaiUai u tallowed by operation i, while B may be im- 
pidPcntE.it by operation a. fulluWrtl by operation G. IF I bare 
a jxrchjprajn which prrfiiTTP* both ,4 and B, I can optimize thin- 
by perform in k a just once and then using its mtput 
CMS the input of both !■' nn-il C- 
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FiRfiTir 5,1, Flow gT-taninuir finfljrient and jjM.'inlri-(!!■■*■■ KTA-pli, Tbe jrrajfli djnp]ay f 
Fnn-mit and can be tan^clrri-ti nn npdnuidtioti of iti« twn Hrrw graphs gettfcf&tod by 

the gr.-iJ,uJI iir fra [fin rat. 


We cannot recover this analyst simply by parsing, because the bow graph 
which represents the optimised program can not be read alt ihe way through 
by our read-head meehilliMn. But eotiHidcr the state of the parser at the 
point where its read head (‘luronntrrs the fan-out, The grazes mar fragment 
stiowra in figure 5.1 will have given rise to the following two item akctetons; 


[& => - * - - J 
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A fan-out handler invoked at this point, basing ]ts actions op i% theory of 
program cpLsnnaation through shared operations, might (i"| replace ex th the 
parser a head petition by oj and ej, and (ii) d Lange these item fragments to 
read: 


[/W 

— A.-H b — ( - - - 1 

My .A , 


V 1 

— aV. 

so 

1 _s 





These actions would allow tin- parser, using the ruLes tif figure 5.1, to recover 
both the desired analyses for the input, 






m 


A Dfttttftuon 


RcewIhTS lii b dinuajitl by tfu.'si'ciuiuj; informality of such a solution,* 
The point liefe in that l>iit parsing algorithm embeds el notion s)f input ttnir- 
tnrc which lIlhv not lake into junjiLUt juion Julies due to sharing- A doiipnin 
tX]MTt which unddflitftndu snwh struct ural eu lorjLOJie's' van nhcmr the pawr tww 
toprncrad in these cni«‘« by ,titering its wtaie in tbe afiirfiiiPiitioiiiil way; tike 
operations theinwlves u my seum low-level hut the t-tkeury underlying them 
is Dot, 

To put it another way. it is important here not to conFusc "represeniatinn- 
leycF with a |ow-Lev«r. Because the ai gevrithm'a nnprc«lliatk«S fairly di¬ 
rectly reflect the grate of the parser* bring a-i undated. a wide MJge of 
grammar- and graph-theoretic opcmtfMii cun he implemented dirtetly via 
aimplo representation-Lewd operations, ha Fart, it is precisely this closeness 
between the theoretic SJjd representational levels that makes QiIh algorithm 
an easy to advise. 


5.3. Correctness , 

Wo have done no substantive work oa a correctness proof for our parsing al¬ 
gorithm. For one thing, such a proof would ideally require definitions of flow 
graphs, flow grammars. and the graph-derivation process which are a great 
deal more rigorons than those presented here. For another, the algorithm 
it-sclF WOuU have to be stated quite a hit more precisely than we have stated 
it, To readers who might be interested in constructing a correctness proof,, 
wc recommend the proof of correctness of Earley's algorithm contained in 
[Aho 40 h] U liman 10721 Tin- structure of that proof Would probably serve 
as a good Lii-odel for a correctness proof in this case. 

5.4. Complexity Analysis 

We conclude by COUHtlfTiiifi the running tinii' of our simulation algorithm, 
lu our analysis. we will he concerned entirely with ohlaining a locuse upper 
bound on worst-east- time complexity as a function of tbe number of nodes 
and edges in the input graph, paying only cursory attention to spore com¬ 
plexity or time/ipaee complexity os a fuitrt Lou of the input grammar The 


L in fact, m orp«t tha: rtiulrrs art KHVniaK ^Guchf Whit * hiclT 
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plant nf tliin Jucw is twofold; (i) W p itrc intended primarily ill exporting 
intuitions nlKmt tin* Hafivo nwi of tin? Algorithm's optral.imm. mil \ii\ me 
will bo satin til'd to show Hint the algorithm display* polynomial rather tliaq 
MtpTOMTitiiij Huh- growth with the sixp rrf the input. 

Tt» %'iriUua spends it) ]ts time, except for a ratutaxii amount At She 
be ginnin g lUlUtillK thje JcaiimT, predictor, and completer over well con¬ 
structed ttfoii. Thus. the total running time of the algorithm is the product 
of the number of construct rd items and the sum of the times needed to 
run each Of these three operation* on an item. We will consider each factor 
Sep irately . 1 

Iel what follows, we wj]] be (using the following definition*} 

p = the nmubn of rules in the (r.unmir, 

if = the maximum number of Inputs to a grammar rule, 

t - the maximum number of pair* In the state of a recognizer, 

h — the maximum number of edges Lu a head position, 

e = the number of I'dges in the input graph, and 

■n — the number of nodes in the input graph. 

In addition, we will oft en he malting an ordered choice of it items from among 
m items. There arc 


m x tn. - 1 x ,.. x m - {Jt - I) = fcf x 

ways of making Huch a choice; we will denote this number by [£]. 

The alpilhia constructs n + 1 lists. On each hsl, any two items must 
differ Ln one of fi) the m|e the-y wore invoked for, (ii) whore in the input they 
were invoked, or (iii) their state. Each start position is an ordered choice of 
at most Tii edges frflJU the e in the input, and each state is determined by an 
OrrlcTcd choice erf at mott t edges from the current head position; thus, the 
number of items a single hat is bounded Above by 

r t 
t 




’Tbia annlysii is pxttffnfd directly alter tbut pno by E*rJ«y id ]!MS| 
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Both c Ell- predjHor and tin- completer need 1u klKW wlietlmr they have 
already added A pnrtjriiljir item 1(3 tlw cmrciil litf-1. If We are cmic-ontod 
fnj]y wi+H running; time (and not space reipiirL'nu'nts). vn- can optimise tills 
[NfNTAtiou to t-oke niu^iuit fiine by keeping A table of all such ihilnt which 
i? imkvod by tin. 1 the llnw faetorH nmuticaieil Above. 3 Wo will assume that 
such ■ r xu optimization is list'd in the following aHFiJy*i-s- 

Now Wo wish to hound tin? time it takes to nm rach of the throe bamc 
operations on a given item i from Lit /j- In this analyst®. Wo will use an 
augmented jircdaCtCsJ* operation that also attaches to each created, tient a 
unique integer identifier. When the c-split operation splits such an Item, 
this identifier will he copied to the split item, allowing the predictor to tell 
in constant time whether two items are e-split* Of each other. 

The scanner either cop in* i or simulates a state tTAIIHtiofl for the recog- 
tu&er represented by i. This takes constant time. In addition, the scanner 
has to chock each af up to t pair* In the item's state part to determine 
whether the item is active on the node read. Tins aito require# time inde¬ 
pendent of the siw of the input gr&ph- 

Wticn the predictor considers an item i on f ? whose state crjntAi&s inputs 
to target noil-terminal's] s it tries to add to ij up to tp item#: one for each 
rile which derives wh of the non-terminals whose inputs have been rtaohed. 
In addition, it may p-sptit the up to [^] members of its call list: a figure 
derived below, Givctl tile optimization described above, checking whether 
each of the resulting items has already been added to the list takes constant 
time, so the predictor takes up to time op each item. 

When the completer considers an item i on Ij whose state part contains 
trailing edges of its target graph, it must process every item in t's return 
Het. Thus, the amount of time taken hy the completer is the product of the 
maximum. number of stoma in a return set and the amount of timn it takes 
to process each such stem. 

Return pointers id an item Arise from (WO sources. Originally, an item 
hag one return pointer for each of its callilLg items. However, a# the paraer 
mils? and its callers split, an item may contain several return pointers to 
difittont splltE of one original caller. Wc consider first how many original 
caller# an item can have, and then how many splits each can turn into, 


n aucli a title. fflT wilt tend l® be very S(JWW; the author's actual fenpLemmiaiinii 

of Lhe ai.ii!inrluFi U«d n rucic compaEi, tulir-ccinnuoidii j repmendJ-icip- 



M Comph'Xity AnrtJyshr 


Ml 


A given snt>-rrro"ni:a<'r It can haw been originally calM from rer- 
ogiii^i'i? at QiK! of u? head petition s (our for rarh of its in]nil , -s) a This, its 
original calling ntopiuif!! iniist have bi™ in ojj(* erf -V must ■ J J states, so 
there can have hiTii of iim#f. 


P x 


t 

uni 



original calling Items- 

Suppose an instance of a recogntlOT r (which was called at some specific 
input position) calls an item i co derive a node n. Every -scats transition 
on a node other than n that tlm- caJhng recognizer take? while i is running 
might split the caller and add up to p return pointers to a'. Since at least 
«n* input of it can not appear, in the state Led to by such a transition, there 
wo at most [ f ” J j possible stales which contribute splits, leading to a total 
return set membership of 


[ i ‘ 
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When a calling item % c- or r-spLta as the rem.slt of a calico’s return, we 
must add the split-off item to the call Uses erft's caJltTs and the return Lists 
of t's callees. This will take a* much time as there are callers and callees. 
Wc saw above that how may callers there are; a similar argument (ntilirir-g 
the symmetry of creation of call and return pointers) shows that there are 
up to [^J[ callces. Thus, splitting an item may take up to the sum of these 
figures, leading to a total coat for the completer of 



When we add the costs of the tEiree operations together, we find that 
the completer dominates the cost of the other operations, so the Cost of the 
entire algorithm is hounded by the product of the completer Cost and the 
total number of items. This product ia polynomial in e; tit the string case it 
reduces to = n 3 which is the cost of Earley's algorithm- 
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